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ADDENDUM 


LOW  COST  ANTI-JAM  DIGITAL  DATA-LINKS  TECHNIQUES  INVESTIGATIONS 
AFAL-TR-77-104.  VOLUME  II 
MAY  1979 

This  addendum  contains  results  which  were  completed  too  late  for  in¬ 
clusion  in  the  main  part  of  the  Interim  Report.  These  results  should  prop¬ 
erly  have  been  included  in  Section  IV.,  1.  However,  the  nature  of  the  re¬ 
sults  is  such  that  none  of  the  findings  or  conclusions  of  the  report  are 
subject  to  change. 

The  Monte  Carlo  simulation  routine,  described  in  [1],  was  modified  to 
include  DPSK  as  a  signal  option,  along  with  PSK  and  FSK.  A  random  sequence 
of  binary  symbols  was  generated  as  usual.  However,  these  symbols  were  then 
differentially  encoded  as  per  Table  1.  At  the  receiver,  several  detectors 
were  implemented.  These  included  the  standard  detector  for  PSK  and  the  IDEI 
detector  for  PSK.  Also,  the  standard  detector  for  DPSK  was  implemented, 
based  on  equations  (78)  -  (83).  Finally,  an  IDEI  DPSK  detector  was  imple¬ 
mented,  using  the  IDEI-PSK  detector  and  differential  decoding. 

Figure  49  shows  the  "calibration  curve"  for  the  various  detectors. 

This  graph  serves  the  same  purpose  as  Figure  7  and  shows  the  Monte  Carlo 
performances  of  the  standard  PSK  detector,  IDEI  detector  with  differential 
decoding  and  standard  DPSK  detector,  respectively,  for  white  noise  only. 

It  is  seen  that  the  results  appear  the  same  as  those  in  [10]  and  [13]. 

Figure  50  shows  the  results  for  multiplicative  noise  equal  in  strength 
to  the  desired  signal,  with  a  low-pass  equivalent  noise  bandwidth  of  275  Hz. 
This  is  the  same  "diffuse  Doppler-spread  multipath"  disturbance  as  was  used 
in  Figure  9.  The  error  rates  for  IDEI  and  standard  detectors  for  PSK  in 
Figure  50  fall  upon  those  in  Figure  9.  The  standard  DPSK  error  rate  is  a 
little  better  than  that  for  PSK,  however  the  DPSK  error  rate  is  still  sat¬ 
urated  and  unusable.  The  error  rate  for  the  IDEI  detector  using  differen¬ 
tial  decoding  is  slightly  worse  than  that  for  PSK,  but  this  is  to  be  expected. 

The  explanation  for  the  poor  performance  of  standard  DPSK  in  this  mul¬ 
tiplicative  noise  environment  is  that  the  disturbance  causes  the  received 
signal  phase  to  violate  the  "slow-phase"  restriction  inherent  in  the  deriv¬ 
ation  of  the  standard  DPSK  detection  algorithm.  Indeed,  the  phase-jitter 
process  has  a  bandwidth  of  at  least  275  Hz.  which  is  not  slow  compared  to 
the  symbol  rate  of  2,500  BPS. 


The  performance  of  the  IDEI  detector  is  good,  not  because  of  the  dif¬ 
ferential  decoding,  but  because  the  equivalent  phase  disturbance  on  the 
received  signal  is  being  tracked  out  by  the  IDEI  detector. 

It  should  be  recalled  that  the  IDEI  detector  is  being  furnished  with 
an  unperturbed  phase  reference  locked  to  that  of  the  transmitted  signal. 
However,  it  has  been  shown  in  a  previous  investigation  [3]  that  the  IDEI 
detector  also  tracks  out  phase  reference  perturbations  due  to  the  multipli 
cative  noise  effects  on  the  carrier  phase-locked  loop,  without  an  increase 
in  error-rate.  Thus  the  present  IDEI  results  are  valid  for  multiplicative 
noise  with  jittery  phase  reference. 

Based  on  the  above,  two  conclusions  are  clear.  DPSK  with  a  standard 
detector  is  unusable  in  diffuse  aeronautical  multipath  due  to  violation  of 
the  "slow-phase"  restriction  on  the  standard  DPSK  detector.  DPSK  is  un¬ 
necessary  in  diffuse  aeronautical  multipath  if  an  IDEI  detector  is  used, 
since  PSK  provides  better  performance. 
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Figure  49.  Simulated  Error  Rate  Check  Case  for  PSK,  DPSK 
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Figure  50.  Simulated  Error  Rate  for  PSK  and 
DPSK  in  Multiplicative  Noise 


PREFACE 


From  1971  through  1973,  a  new  sampled-data  processing  technique  for 
anti-multipath  reception  of  aeronautical  data-link  signals  was  developed, 
and  subsequently  patented  by  the  Principal  Investigator,  at  NASA  Langley 
Research  Center.  In  1974  a  contract  was  issued  by  the  Air  Force  Avionics 
Laboratory  to  determine  if  the  same  technique  which  provided  processing  gain 
against  diffuse  Doppler-spread  multipath  perturbations  could  be  modified 
for  use  in  anti-jam  processing. 

Anti-jam  processing  algorithms  were  produced  under  the  1974  contract, 
as  well  as  a  Monte  Carlo  simulation  package  for  evaluating  the  performance 
of  the  algorithms.  The  contract  was  extended  in  1976  for  the  purpose  of 
making  an  exhaustive  performance  evaluation  of  the  new  processing  algorithms. 
The  present  report  gives  the  results  of  the  performance  evaluation  conducted 
during  the  period  from  October  1976  through  February  1978. 

The  results  of  the  performance  evaluation  have  been  favorable  toward 
continued  development  of  the  A-J  processing  technique.  Further  investiga¬ 
tions  have  been  identified  and  the  contract  has  been  extended  for  a  further 
period.  The  present  results  have  shown  the  A-J  processing  gain  which  is 
available  through  the  new  technique.  Future  efforts  will  be  devoted  to 
means  for  realizing  this  gain. 
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SECTION  I 


INTRODUCTION 

This  is  a  report  on  the  second  phase  of  an  investigation  into  new 
techniques  for  communicating  digital  data  between  two  terminals  in  an  en¬ 
vironment  subject  to  multiplicative  and  additive  colored  noise  and  additive 
white  noise.  The  multiplicative  noise  is  a  model  for  non -frequency- selec¬ 
tive  fading  due  to  Doppler-spreading  such  as  caused  by  diffuse  multipath 
reflections.  The  additive  colored  noise  is  a  model  for  radio-frequency 
interference  or  jamming. 

The  communication  technique  being  investigated  is  a  receiver-based 
processing  technique  for  standard  signal  modulations  such  as  Phase-Shift- 
Keying,  Frequency-Shift-Keying  and  Differential-Phase-Shift-Keying.  The 
technique  does  not  require  the  use  of  Spread-Spectrum  modulations.  The 
particular  processing  used  is  called  Integrated  Detection,  Estimation,  and 
Identification  (IDEI).  It  is  nearly  optimum,  under  the  minimum  probability 
of  error  criterion,  for  M-ary  signalling  in  additive  and  multiplicative 
Gaussian  noise. 

The  results  of  the  first  phase  of  the  investigation  were  documented 
in  [1].  In  that  phase  the  optimum  IDEI  algorithms  were  derived  and  an 
elaborate  Monte  Carlo  simulation  package  was  written  for  testing  the  algo¬ 
rithms  for  PSK  and  FSK  binary  signals.  The  purposes  of  the  second  phase 
of  effort  were  several.  First,  it  was  required  to  determine  the  best  per¬ 
formance  of  the  IDEI  algorithms,  operating  with  known  bit  timing  and  carrier 
phase  references,  and  for  perfect  identification  of  the  required  statistics 
of  the  colored  interfering  processes.  Second,  it  was  required  to  determine 
the  sensitivity  of  the  detection  algorithms  to  accuracy  of  the  identifica¬ 
tion  of  the  interference.  Third,  it  was  required  to  derive  and  validate 
optimum  identification  algorithms.  Finally,  it  was  required  to  form  an 
initial  estimate  of  receiver  practicality. 

The  four  requirements  on  the  fourteen  month  investigation,  described 
above,  have  been  fulfilled  and  the  results  are  documented  below.  During 
the  course  of  the  investigation  a  closed-form  numerical  expression  was 
derived  for  evaluating  the  best  performance  and  the  sensitivity  of  the 
IDEI  detector.  Use  of  the  closed-form  for  numerical  computations  was  much 
more  efficient,  time-wise,  than  was  use  of  the  Monte  Carlo  simulation. 

Thus,  more  voluminous  results  were  produced  than  might  have  been  anticipated 
on  a  simulation  basis  only. 
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This  report  contains  five  main  sections,  excluding  the  Introduction  and 
Conclusion.  In  Section  II  are  presented  all  the  mathematical  analyses 
pertaining  to  the  probability  of  error,  or  error  rate,  of  the  IDEI  detector. 
These  include  the  derivation  of  the  closed-form  error  rate  expression 
under  mis-identification,  a  spectral  analysis  of  the  IDEI  detector  with 
perfect  identification,  the  IDEI  detection  algorithms  for  DPSK,  closed- 
form  error  rate  determination  for  standard  detectors,  and  the  derivation  of 
the  Uniformly  Most  Powerful  property  of  the  IDEI  detector. 

In  Section  III  are  presented  the  mathematical  derivations  and  results 
for  Maximum-Likelihood  Identification  of  In-Phase/Quadrature  Vector 
Processes.  These  include  derivation  of  a  minimum  canonical  form  for  the 
I-Q  generator  model,  derivation  of  the  M-L  identification  algorithms,  and 
validation  results  for  the  estimation  performance  of  the  MLI  algorithms. 

In  Section  IV  are  presented  all  the  numerical  results  obtained  in  the 
present  investigation,  either  by  Monte  Carlo  methods  or  by  closed-form 
numerical  evaluation.  These  include  a  comparison  of  Monte  Carlo  versus 
closed-form  error-rate  results  for  PSK  and  FSK,  IDEI  error-rate  with  per-, 
feet  identification,  IDEI  error-rate  sensitivity  to  identification  error, 
and  error-rate  performance  of  the  MLI  algorithms. 

Section  V  contains  the  receiver  design  and  practicality  evaluation. 
Section  VII  contains  the  appendices. 

The  outcome  of  this  second  phase  of  the  investigation  may  be  summa¬ 
rized  as  follows.  It  will  be  shown  below  that  the  IDEI  detection  algo¬ 
rithms  are  reasonably  robust  (insensitive)  to  error  in  identification  of 
the  colored  interference  process  statistics,  provided  the  errors  are  made 
in  a  particular  way.  If  the  tracking  filters  are  synthesized  to  match  an 
identified  disturbance  process  which  is  of  different  bandwidth  and/or 
strength  from  the  true  process,  then  the  algorithms'  performance  changes 
smoothly,  proportional  to  the  bandwidth  or  strength  errors.  If,  however, 
the  filter  parameters  are  directly  identified  from  the  received  signals 
using  an  optimum  stochastic  (maximum-likelihood)  technique,  rather  than 
synthesized  in  a  deterministic  manner,  the  detector  performance  is  highly 
sensitive  to  identification  error.  Thus  it  appears  that  the  practicality 
of  the  IDEI  algorithm  hinges  on  the  exact  method  by  which  identification 
is  implemented.  Further  work  is  suggested  in  this  area. 


It  is  also  shown  below  that  the  best  perfonnance  (perfect  identifica¬ 
tion)  of  the  IDEI  detector  is  orders  of  magnitude  better  than  that  of 
standard  matched  filter  detectors  in  an  environment  of  heavy  additive  col¬ 
ored  noise.  The  IDEI  detector  provides  gain  against  narrow-band  interfer- 
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ence  equivalent  to  spectrum-spreading  factors  of  the  order  of  10  to  10  . 
It  is  also  shown  that  the  amount  of  gain  is  a  function  not  only  of  the 
interference  to  signal  ratio,  but  also  of  the  degree  of  similarity  between 
signal  spectrum  and  interference  spectrum. 

Suggested  steps  toward  reducing  the  present  theoretical  results  to 
practice  are  outlined  in  Section  VI. 


SECTION  II 


ERROR  RATE  ANALYSES  FOR  INTEGRATED 
DETECTION.  ESTIMATION,  AND  IDENTIFICATION 

1.  CLOSED-FORM  ERROR  RATE  UNDER  MIS-IDENTIFICATION 

The  emphasis  of  the  work  being  presently  reported  was  on  the  perfor¬ 
mance  of  the  new  disturbance-tracking  IDEI  coherent  detection  algorithms 
for  binary  signals  subject  to  additive  colored  plus  white  noise.  The 
colored  noise  represents  a  jamming  signal  while  the  white  noise  represents 
receiver-generated  interference.  Thus,  the  analytical  results  presented 
in  this  section  are  based  on  a  simplification  of  the  more  general  multi- 
path  and  jamming  model  treated  in  [1].  It  is  assumed  that  the  received 
data  is  in  In-phase/Quadrature  (I-Q)  form,  resulting  from  a  standard 
coherent  product  demodulation  of  the  band-pass  radio-frequency  signal. 

A  vector-Markov  data  generating  model  is  hypothesized,  as  in  Figure  1. 

The  data  model  has  been  obviously  simplified,  such  as  by  deleting  any  vec¬ 
tor-multiplicative  noise  as  might  result  from  impure  phase  references  in 
the  I-Q  demodulator.  Such  effects  have  been  treated  elsewhere  [1,  2,  3]. 
The  simple  model  will  suffice  for  the  present  investigation. 

In  Figure  1,  the  I-Q  data,  z(k),  is  in  sampled-data  2-vector  form, 
where  k  is  sample  number.  4(k;m)  is  a  2-vector  waveform  representing  the 
low-pass  I-Q  components  of  the  transmitted  signal,  m  is  the  transmitted 
symbol,  taken  here  as  a  member  of  the  binary  alphabet,  {0,  1}.  Given  the 
value  of  m,  the  waveform  of  £(k;m)  is  known  for  al 1  k  =  1 ,  2,  . . . .  It 

is  assumed  that  the  signals,  4(k;m  =  0)  and  £(k;m  =1),  are  A  Priori 

equally  likely  and  have  equal  energy  on  the  symbol  period.  Likewise,  n(k) 
is  the  I-Q  2-vector  of  additive  white  Gaussian  noise.  in(k)  is  taken  as 
zero-mean  with  known  diagonal  variance  matrix, 

In  Figure  1,  the  additive  colored  noise  is  generated  as  ^(k).  The 
2- vector,  y(k),  is  obtained  from  a  2N- vector,  x(k),  through  the  output  2 
by  2N  matrix,  A.  The  transition  matrix,  <t>,  is  2N  x  2N,  The  filter  which 
produces  ^(k)  is  excited  by  a  white,  zero-mean,  unit-variance  Gaussian 
input  2-vector,  w(k).  The  input  matrix,  r,  is  2N  x  2.  By  choosing  the 

constant  filter  structure,  {r,  i-.  A,  N),  properly,  the  filter  will,  in  the 

steady-state,  generate  a  stationary,  zero-mean  y(k),  having  a  prescribed 
covariance  matrix,  V^^(j)  for  j  =  0,  1,  2 .  Using  a  suitable  sampling 
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model,  the  covariance  matrix,  Vyy(j)  may  be  related  to  the  continuous-time 
power  spectrum  of  the  additive  colored  interference.  The  equations  govern 
ing  the  data  generator  are: 


x(k  +  1)  =  'fxlk)  +  rw{k);  x(0)  prescribed 

l(k)  =  Ax(k) 

l(k)  =  4(k;m)  +  ^(k)  +  Ji{k);  E{y^(k)}  =  E{n(k)}  =  0 

m  =  0,  1 


Vyy{j)  =  lif  E{^(k  +  j)^^(k)}; 

k-KO 


Vnn(k  -  j)  =  E{n(k)J(j)}  = 


k  =  1,  2 . 

j  =  0,  1,  2 . 


6 


jk 


is  Kroneker  delta 


''nn  "  °n^2x2 


(1) 


With  the  data  modeled  as  discussed  above,  the  IDEI  detector  takes  the 
form  of  Figure  2,  which  is  a  special  case  of  the  more  general  receiver  for 
multiplicative  and  additive  noise,  treated  in  [1].  This  version  of  the 
IDEI  detector  is  the  decision-directed  approximation  to  the  optimum  detec¬ 
tor  under  the  Maximum  A  Posteriori  Probability  (or  Maximum  Likelihood,  or 
Minimum  Probability  of  Error)  criterion.  The  detector  operates  as  follows. 

From  each  incoming  data  sample  in  the  upper  branch  is  subtracted  the 
corresponding  sample  of  the  signal  reference  waveform  for  the  symbol  m  =  0. 
In  the  lower  branch,  the  reference  waveform  for  m  =  1  is  subtracted  from 
the  data.  Following  the  signal  subtraction  is  a  filter  which  attempts  to 
track  the  colored  additive  noise,  y(k),  in  the  presence  of  the  white  noise, 
n(k).  The  filter  is  linear  and  is  in  the  canonical  form  of  a  Kalman  filter 
with  gain,  G.  Under  the  stationarity  assumption  the  gain  G  is  constant 
and  the  steady-state  Kalman  filter  is  just  a  particular  form  of  the  Wiener 
filter  [4].  Note  that  the  requirement  for  an  exact  signal  reference 
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waveform  implies  identifying  the  level  or  strength  of  the  desired  signal 
component  in  the  received  data.  This  implication  was  commented  upon  in 
[1].  However,  it  turns  out  that  the  IDEI  algorithms  possess  the  Uniformly 
Most  Powerful  [5]  property  with  respect  to  the  strength  of  the  desired 
signal  component.  This  property  is  derived  in  a  following  section.  The 
effect  of  this  property  upon  identification  is  detailed  below. 

The  feedback  tracking  error  waveform  in  each  filter  is  designated 
ej(k;m;n).  The  argument  n  denotes  the  assumed  symbol  (and  filter).  The 
argument  m  denotes  the  symbol  actually  present  in  the  data,  e^i  )  is  a 
2-vector.  The  tracking  error  waveforms  from  each  filter  are  processed  in 
a  quadratic  form  which  essentially  squares  and  averages  the  waveforms  over 
the  K  samples  per  signal  symbol.  The  sum-squared  tracking  errors  for  each 
filter  are  then  compared  at  the  end  of  each  symbol  period.  The  filter 
displaying  the  least  sum-squared  tracking  error  is  assumed  to  have  been 
using  the  "correct"  signal  reference  and  the  symbol  decision  is  made  ac¬ 
cordingly. 

The  tracking  filters  are  operated  with  decision  direction.  At  the 
end  of  a  symbol  period,  after  decision  has  been  made,  the  state  vector  of 
the  "wrong"  filter  is  reset  to  the  state  of  the  "correct"  filter.  In  the 
case  of  a  correct  previous  decision,  both  filters  start  the  subsequent 
symbol  period  "locked"  to  the  colored  additive  interference,  ^(k).  In  the 
case  of  an  incorrect  decision,  both  filters  are  incorrectly  initialized 
for  the  following  symbol  period. 

Monte  Carlo  simulations  have  been  used  to  evaluate  the  performance  of 
the  IDEI  detection  algorithms.  These  results  are  given  below.  The  algo¬ 
rithms  were  exercised  with  colored  multiplicative  noise  or  colored  addi¬ 
tive  noise,  individually,  along  with  white  additive  noise.  The  simulated 
error  rates  were  compared  with  those  of  standard  detectors  for  both  binary 
PSK  and  FSK  modulations.  It  was  found  that  for  white  noise  only,  the  new 
detection  algorithms  gave  exactly  the  same  errors,  symbol  for  symbol,  as 
the  standard  algorithms.  However,  in  the  presence  of  colored  additive  or 
multiplicative  noise  the  IDEI  algorithms  always  yielded  better  performance 
than  did  the  standard  receiver. 

Naturally,  it  is  desirable  to  have  closed-form  expressions  for  the 
error  rate  performance,  to  back  up  and  extend  the  simulation  results. 

Such  expressions  are  readily  obtained,  provided  one  more  assumption  is 


made.  The  probability  of  error  for  a  particular  symbol  is  easily  formu¬ 
lated  under  the  assumption  that  the  tracking  filters  were  correctly  initi¬ 
alized  or,  equivalently,  that  the  previous  decision  was  correct.  This 
assumption  becomes  increasingly  good  as  the  error  rate  becomes  smaller, 
provided  the  errors  do  not  cluster.  Error  rate  curves  based  on  the  assump 
tion  will  be  lower  bounds  for  the  practical  IDEI  error  rate  performance. 

A  comparison  with  Monte  Carlo  results  for  clustered  errors  will  show  the 
usefulness  of  the  lower  bound. 

Linder  the  assumption  of  a  correct  prior  decision,  the  general  detec¬ 
tion  statistic  of  [1]  may  be  written  as 

T  -1  T 

S  =  I  ej(k;m;n  =  0)  Vjj  e^y(k;m;n  =  0)  -  e^(k;m;n  =  1)  • 

Vj|  ej{k;m;n  =1)  (2) 

where  ej(k;m;n)  is  the  filter's  total  transient  tracking  error  waveform 
and  Vjj  is  the  assumed  Innovations  variance.  From  Figure  2  it  may  be  seen 
that  the  total  transient  tracking  error  may  be  partitioned  into  a  response 
due  to  the  zerc-mean  Gaussian  noises  (colored  and  white)  and  a  response 
due  to  the  desired  signal  and  reference  terms.  Thus,  define 

ej(k;m;n)  =  c(k)  +  e^(k;m;n)  (3) 

where  ^(k)  is  the  (pseudo-innovations)  response  due  to  zero-mean  stochas¬ 
tic  input  and  e^(k;m;n)  is  the  filter's  transient  response  to  a  driving 
function 

^(k)  =  4(k;m)  -  a;6(k;n)  (4) 

In  (4)  a  is  the  identification  estimate  of  the  desired  signal  level, 
which  is  unity  for  perfect  identification.  Because  of  the  Uniformly  Most 
Powerful  property  of  the  IDEI  algorithms,  a  may  just  be  set  to  unity. 

When  identification  is  perfect,  including  the  filter  parameters,  then  £(k) 
is  identically  y(k) ,  the  Innovations  process,  and  ^(k)  is  identically  zero 


when  m  =  n.  Thus, 


^(k;m;n)  =  0 
ejk;m;n)  f  0 

i(k)  =  v(k) 


V  k  ;  m  =  n 

V  k  ;  m  ^  n 

Perfect  Identification  (5) 


Substituting  (3)  into  (2)  yields 


S  =  I  {2c^(k)  V‘!  [e  (k;m;n  =  0)  -  e  (k;m;n  =  1)  + 
k=l  “  “ 

e^{k;m;n  =  0)Vt|  e,(k;m;n  =  0)  -  e^Ck-.m-.n  =  1) 

— '^6  1 1  — -o  ““A 

Vj}  e^(k;m;n  =  1)}  (6) 


The  process,  £(k),  is  zero-mean,  Gaussian  and,  conditioned  on  m  the  e, (  ) 
are  deterministic.  Thus  S  is  conditionally  Gaussian  and  is  described  by 
the  following  means  and  variances. 


E{Slm=0} 


^  T  -1 

I  [e‘ (k;m='0;n=0)V,;  e  (k',m=0-,n=0) 

k=l 


+ 


-e^(k;m=0;n=l  )VjJ  e^^(k;m=0;n=l )  =  -y 
k  T  _1 

E{S|m=l}  =  y  [e‘ (k;m=l ;n=0)V,|  e. {k;m=l ;n=0)  + 
k=l  ^ 


-e^(k;m=l;n=l)V‘]  e^(k;m=l ;n=l )]  ^  y  (7) 


In  (7)  the  assumption  has  been  employed  that  (equal  energy)  the  sum-squared 
tracking  errors  are  equal.  The  conditional  variances  are 
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t-s. 


var{S|m=0}  =  var{Sim=1}  = 


4  I  I  [e  (j;m=0;n=0)  -  e  ( j ;m=0;n=1 )]^V • 
j=l  k=l  ^  “ 

V^^(j-k)VjJ[e^(k;m=0;n=0)  -  e^(k;m=0;n=l )]  ^  (8) 

where  V^^(j-k)  is  the  auto-covariance  function  of  the  process,  £(k),  which 
is  in  general  colored. 

It  is  shown  in  Appendix  A  that  the  auto-covariance  function  of  the 
pseudo-innovations,  £(k)  is  given  by 

V^^(-£)  =  aC$*(I  -  G*A)]^“^$*[V5^A^  -  G*(aV^a''^  +  V^^)] 

I 

+  A  [  [f*(I  -  G*A)]'^‘^  •  ''-a''^;  0  <  t 

i=l 

=  *  '‘m-  “  =  ^  <S> 

where  and  G*  are  the  values  of  the  identified  (or  assumed)  transition 
matrix  and  Kalman  gain  respectively.  and  <l>  are  related  by 

<t*  =  $  -  A-t  (10) 

The  quantity  is  the  actual  predicted  state  estimation  error  variance 
matrix.  The  quantity  V  -v  is  the  cross-variance  between  the  state  and 
state  prediction  error.  Both  and  are  obtained  as  solutions  to 
appropriate  discrete-time  Ricatti  difference  equations,  which  are  derived 
in  Appendix  A.  The  method  of  solution  used  is  to  propagate  the  equations 
numerically  until  steady  state  is  reached,  according  to  a  Cauchy  test  on 
succeeding  stages.  The  quantity,  is  the  variance  matrix  for  the 
white  additive  noise,  n(k). 

With  u  and  a  defined  by  (7)  and  (8),  respectively,  the  error  rate  or 
probability  of  error  is  given  by 


P(e)  =  h  -  erf(-^)l 
/2a 


(n) 


where  "erf"  denotes  "error  function".  For  the  case  where  identil ication  is 
perfect,  (7)  and  (8)  simplify  and  (11)  becomes 


P(e)  =  i  [1  -  erf(— )]  = 


1 

2 


-  erf 


^  T  1 

I  e' (k:m=l ;n=0)  V~ 


^^^(k.:m=l;n=0) 


(12) 


where  V  is  the  true  Innovations  variance. 
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2.  SPECTRAL  ANALYSIS  OF  THE  IDEI  DETECTOR  WITH  PERFECT  IDENTIFICATION 

It  has  been  observed  lately  by  Schwartz  [6]  ...  "that  the  discrete¬ 
time  formulation  may  provide  insight  into  constructive  techniques  for 
realizing,  or  approximating,  the  rather  general  (and  sometimes  abstract) 
results  that  have  appeared  for  the  continuous-time  versions."  ...  of 
receivers  containing  estimators.  The  observation  certainly  proved  true 
for  the  IDEI  receiver  wherein  the  disturbance  tracking  feature  was  a 
direct  result  of  the  discrete-time  sequential  formulation  of  the  detec¬ 
tion  statistic.  However,  the  present  formulation  of  the  error  rate  prob¬ 
ability  on  a  discrete-time  basis  yields  even  more  insight  into  the  detec¬ 
tion  problem. 

For  instance,  equation  (12)  shows  that  the  effective  noise  in  the 
detection  problem  is  evidently  the  Innovations  process,  since  its  vari¬ 
ance,  plays  the  part  of  in  the  error  function  argument.  Thus 
the  error  rate  is  controlled,  not  be  the  total  power  of  the  additive 
colored  interference,  but  rather  by  the  power  in  the  untracked  portion 
of  the  colored  interference,  plus  the  white  noise  power.  Secondly,  the 
Innovations  variance  is  minimized,  and  consequently  the  error  rate  is 
minimized  when  the  filter  is  "matched"  to  the  colored  interference  wave¬ 
form  in  the  Wiener  sense. 
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Equation  (12)  also  shows  that  the  effective  signal  power  is  propor¬ 
tional  to  the  sum  of  the  squares  of  the  deterministic  tracking  error  wave¬ 
form  of  the  "matched"  filter  when  driven  by  the  difference  of  the  two 
possible  versions  of  the  transmitted  signal.  There  are  two  obvious  ways 
to  maximize  this  effective  signal  power  and  thus  minimize  the  error  rate. 
One  is  to  maximize  the  distance  between  the  two  signal  vectors,  i(k;m=0) 
and  A(k;m=l).  The  maximum  distance  is  obtained  when  the  two  possible 
transmitted  signals  are  anti -correlated.  Optimization  may  also  be  obtain¬ 
ed  by  designing  the  signal  waveform  so  as  to  maximize  the  tracking  error 
at  each  sampling  instant.  Note  that  the  deterministic  transient  error 
response  of  the  "matched"  filter  will  only  approach  zero  identically  when 
the  filter  bandwidth  (and,  hence,  the  bandwidth  of  the  colored  interfer¬ 
ence)  is  orders  of  magnitude  greater  than  the  transmitted  signal  bandwidth. 

While  the  formulation  of  (12)  lends  itself  to  some  qualitative  obser¬ 
vations  about  the  behavior  of  the  detector,  it  is  desired  to  translate  the 
parameter,  g//2a,  into  a  different  form.  In  his  treatment  of  the  optimum 
continuous-time  detection  of  known  binary  signals  in  colored  noise, 

Blachman  [7]  was  able  to  relate  detector  performance  to  the  spectra  of 
signals  and  noise.  The  present  discrete-time  problem  may  be  examined 
similarly  by  assuming  arbitrarily  fast  sampling  and  transforming  to  con¬ 
tinuous-time. 

A  continuous-time  version  of  the  sampled-data  detector  may  be  set  up 
by  assuming  that  the  symbol  interval  is  the  closed  interval,  [-T/2,  T/2]. 
The.  continuous  decision  statistic  is  then 

T/2  .  j 

S  =  f  [eT(t;m;n=0)  ey(t;m;n=0)  -  eT(t;m;n=l) 

-T/2  '  '  ‘ 

ej(t;m;n=l )]dt  (13) 

The  mean  and  variance  of  the  statistic  are  then 
T/2  j 

V  =  J  e  (t;m=l;n=0)  e, (t;m=l :n=0)dt 

-T/2  ^  (14) 

T/2  T/2  , 

0^=4/  /  e' (t;m=0;n=l )V  (t-f )e,(t;m=0;n=l )dtdt' 

-T/2  -T/2  ^  i 
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Now  define 


i'(t)  =  1 ; 
=  0; 


t  L  [-T/2.  T/2] 
otherwise 


and  define 

x{t)  =  ii(t)  •  e.(t;m=0;n=l ) 

Then  (14)  may  be  written  as 
u  =  ^ (t)x(t)dt 

^  Co.  Coo  x^(t)V^^{t-t')x(t' )dtdt' 


(15) 


(16) 


(17) 


By  ParsevaTs  Theorem,  then, 

M  /!„  X^(u.)X*(a.)du,  (18) 

where  X(a))  is  the  Fourier  Transform  of  x(t),  and  O*  denotes  complex 
conjugate. 

Next  observe  that 

V  (t-t’)x(t')dt'  =  V  (t)*x(t)  ^  a(t)  (19) 

where  ()*()  denotes  convolution.  Thus 
(t2  =  4  x^(t)a(t)dt 

=  4[-^  /  X^(a))  2*((»))d(ij] 

cTT  -00  — 

=  4[|-  /”  x''^(u))[S.  (u))X(u>)]*du]  (20) 

where  5  (w)  is  the  Fourier  Transform  of  the  auto-covariance  matrix  func 

tion  of  the  pseudo-innovations. 
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Now,  X(u))  is 


X(a.)  =  [T  Sinc(g)]*i^{a.) 


(21) 


where  Efoj)  is  the  Fourier  Transform  of  the  transient  error  waveform, 

— O 

e^(t-,m=l ;n=0) ,  and  sinc(  )  is  the  function 


sinc(x) 


sin(Trx) 

■trx 


(22) 


Thus,  the  argument  of  the  probability  of  error  function,  P(e),  is 

k  [T  sine 

/'^  rjT  s1nc(g).ij(,.)fs|^(»)[T  sinc(|J).E^(u)]*d„ 

(23) 

Now,  assume  perfect  identification  and  also  that  the  bandpass  spec¬ 
trum  of  the  additive  colored  interference  is  even-symnetric  with  respect 
to  the  carrier  frequency  of  the  transmitted  signal.  Then,  £(t)  is  the 
true  innovations  and  is  white.  Thus,  is  diagonal  and  constant, 

with 

=  n[J  f]  (24) 

where  n  is  the  white  noise  spectral  density  for  each  I  and  Q  component  of 
the  white  noise.  Note  that  the  bandpass  white  noise  density  is  ri/2. 

Then  (23)  becomes 

^  ‘/ITC  k  s1nc(^).E4(»)][T  s(„c(|l).ij(.)]d„ 
rZa 

(25) 

Since  the  additive  colored  interfering  process  spectrum  is  even-symmetric 
with  respect  to  carrier  frequency,  the  I  and  Q  portions  of  the  Wiener 
filter  are  not  cross-coupled.  Then 
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(26) 


-i 


S  i(iii) 


I  HgCu,)  S^j(a,) 
t  Hg(a.)  S^Q(a.)  i 


where  Hg(u)  is  the  Wiener  filter  transfer  function  from  input  to  error 
point,  for  either  the  I  or  the  Q  filter.  and  S^g(a))  are  the  Fourier 

transform  of  the  differences  of  the  two  possible  I  and  Q  signal  components, 
respectively. 

Now  Hg(u)  is  a  whitening  filter  for  the  sum  of  additive  colored  inter¬ 
ference  plus  white  noise.  The  transfer  function  is  such  that 


|Hg(a))p  •  CSyy(u)  +  n]  =  n  (27) 

where  ^^^(w)  is  the  spectral  density  of  either  the  I  or  Q  component  of 

the  colored  interference.  To  minimize  the  error  rate,  P(e),  requires 

maximazation  of  ,  as  given  in  (25).  This  requires  maximizing  the 
/2a 

integral  of  the  convolution  of  T*sinc(|^)  with  the  whitened  S^j(o))  and 

S^q(u)). 

To  obtain  more  visibility  into  the  problem,  assume  that  the  length 
T  of  the  detection  interval  is  much  greater  than  the  reciprocal  of  the 
highest  frequency  present  in  the  whitened  difference  signal  spectrum. 
This  would  occur  if  the  symbols  were  being  detected  in  blocks  (block¬ 
coding).  Then  the  convolution  with  T*sinc(|^)  approximates  convolution 

with  a  delta  function,  which  just  reproduces  E  (w).  Then  (25)  becomes 


u 

/2a 


^  ll(“)  •  IJ('*))dw 


|Hg(co)|2  .  f|S^j(u.)|2  + 


S^q(w) I^Jdu 


r 


1 

8 


Syy(“)  +  n 


du 
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(28) 


.....  ..  .,x.i .. ..  .x 


m 


In  terms  of  the  band-pass  parameters,  (28)  is 


ti 

1^0 


2v  ■^-00  4  Syy(oj)  +  n 


(29) 


The  limiting  case  of  (29)  as  n  -*■  0  is  the  classical  whitening  filter 
result,  given  by  Blachman  [7]. 

In  the  form  of  (29)  it  is  clear  why  some  signals  should  outperform 

others  for  a  fixed  interfering  spectrum.  Suppose  the  spectrum, 

decreases  as  for  increasing  m  and  the  spectrum  |S,(u)|^,  decreases  as 
11  ^ 

0) 

For  M  <  N,  as  white  noise  level,  n,  goes  to  zero,  the  intergrand 

(i)  N  M 

approaches  ku  and  the  infinite  integral  becomes  arbitrarily  large. 

This  would  be  a  singular  detection  problem.  In  practice,  however,  n  will 

K 

remain  finite  and  the  integrand  will  approach  For  1  <  M,  singular 

U) 

detection  will  not  occur. 

As  Blachman  commented,  it  is  clear  that  '•he  spectrum  |S.(a))|2  should 
be  made  large  where  the  spectrum  is  small  and  vice  versa,  in  order 

to  minimize  P(e).  Failing  this,  the  tails  of  the  spectrum  [S  (u)|2  should 
be  made  to  decay  at  a  rate  less  than  that  of  ^yyM>  at  least  in  the  fre¬ 
quency  range  over  which  the  detector  responds. 

Example:  PSK  Versus  FSK 

(28)  will  be  evaluated  for  PSK  and  FSK  signalling  waveforms.  The  In- 
phase  and  Quadrature  low-pass  waveforms  are 


Aj(t;m)  =  A  coS(ti(t;m) 

*Q(t;m)  =  A  sin((i(t;m) 

(30) 

where 

(()(t;m)  =  A<|ic(m)  ;  PSK 

=  Au)t*c(m);  FSK 

(31) 

and 

c(m)  =1  :  m  =  0 

=  -1 :  m  =  1 

(32) 

where  and  Au  are  the  modulation  index  and  frequency  deviation, 
respectively.  Then, 
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The  FSK  result  may  be  shown  to  be 


|S^Q(a))|2  =  4A2[_^  Sin(a.  +  Ao.)^  - 
sin(w  -  Au)j]2 


_ 1 _ 

0)  -  Ato 

:FSK 


(38) 


It  can  be  shown  that  both  the  PSK  and  FSK  spectra  decay  as  for 

large  w.  Thus,  any  difference  in  performance  (as  observed  in  the  following 
section)  is  not  due  to  the  high  frequency  behavior  of  the  spectra.  Or 
such  is  the  conclusion  to  be  drawn  from  the  simplification  of  (28), 
Therefore  the  performance  difference  must  be  explained  by  the  detailed 
behavior  of  (25)  in  the  frequency  region  of  the  main  bodies  of  the  signal 
spectra. 


3.  IDEI  DETECTION  OF  DIFFERENTIAL  PHASE  SHIfT  KEYING 

Another  type  of  signal  modulation  for  which  comparisons  between  IDEI 
and  standard  detectors  were  desired  is  the  Differential  Phase-Shift- 
Keyed  (DPSK)  signal,  OPSK  was  first  described  as  a  technique  used  in  the 
Collins  Kineplex  system  [8,  9,  10].  Kineplex  actually  embodied  techniques 
which  later  were  analyzed  and  characterized  as  DPSK,  Quadri -phase,  and 
L-Orthogonal  Signalling  [11]. 

DPSK  was  an  ad  hoc  development  to  circumvent  channel  perturbations 
of  the  phase  »'eference  required  for  coherent  detection  of  PSK.  It  was 
based  on  the  premise  of  a  slowly  varying  phase  disturbance  process  with  a 
time  constant  (inverse  bandwidth)  much  greater  than  one  symbol  period. 
Under  this  assumption,  the  next  previous  symbol  may  be  used  as  the  phase 
reference  for  detection  of  the  present  symbol.  The  channel  which  best 
fits  this  model  is  the  HF  channel,  for  which  Kineplex  was  designed.  Many 
channels  do  not  fit  the  model,  such  as  the  aeronautical  data-link  channel, 
subject  to  Earth-reflective  multipath. 

The  DPSK  signalling  scheme  is  to  reverse  the  signal  phase  between 
previous  and  present  symbol  if  the  present  symbol  is  a  "1"  and  not  to 
reverse  if  the  present  symbol  is  a  "0".  Let  m(j)  denote  the  signalling 
symbol  (waveform)  on  the  jth  time  period  and  n(j)  denote  the  information 
symbol  (bit)  on  the  jth  time-period.  Consider  the  truth  table  of  Table  1. 


TABLE  1 


TRUTH-TABLE 


m(j-1) 

m(j) 

Reversal 

n{j) 

m(j-l)  ■+)m(j) 

0 

0 

No 

0 

0 

0 

1 

Yes 

1 

1 

1 

0 

Yes 

1 

1 

1 

1 

_ 

No 

—  j 

0 

_ 1 

0 

Table  1  shows  that  the  classic  DPSK  signalling  scheme  is  identical  to 
differential  encoding  of  the  signalling  symbols.  That  is,  for  DPSK  it  is 
true  that 


n(j)  =  m(j)  (+)  m{j-l )  (39) 

Since  (39)  describes  classic  DPSK,  it  is  obvious  that  DPSK  may  be 
detected  either  coherently  or  non-coherently.  When  detected  non-coher- 
ently,  the  detection  algorithm  must  consider  data  over  two  signal  symbol 
intervals  in  order  to  make  the  decision  as  to  whether  or  not  a  phase  tran¬ 
sition  occurred.  When  detected  coherently,  each  signalling  symbol  may  be 
detected  individually  and  the  information  symbol  decoded  from  (39).  In 
terms  of  sampled-data  processing,  it  is  obvious  that  coherent  detection 
of  DPSK  may  be  implemented  recursively.  Non-coherent  detection  may  need  to 
store  all  the  data  samples  from  the  preceding  signalling  interval  and  may 
or  may  not  be  implemented  as  a  recursive  process. 

The  question  of  whether  to  implement  coherent  or  non-coherent  detec¬ 
tion  for  DPSK  depends  on  the  type  of  channel  involved  and  the  performance 
of  the  detector  in  that  channel.  For  a  standard  DPSK  detector,  a  non¬ 
coherent  scheme  should  be  used  since  DPSK  was  invented  to  overcome  the 
short-comings  of  the  standard  coherent  PSK  detector.  For  the  IDEI  detector 
in  its  present  stage  of  development,  detection  must  be  coherent.  This  is 
because  the  present  IDEI  detection  algorithms  are  coherent  algorithms. 
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It  was  not  a  task  of  the  present  contract  to  derive  IDEI  algorithms  on 
a  non-coherent  basis. 

It  has  been  shown  [12],  and  will  be  documented  below,  that  the  coher¬ 
ent  IDEI  detector  for  PSK  operates  well  under  heavy  aeronautical  multi - 
path  conditions.  It  was  previously  shown  in  a  NASA  investigation  of  the 
IDEI  detector  [3]  that  using  a  very  unstable  phase  reference  derived  from 
the  multipath  channel  does  not  change  the  error  rate  from  that  caused  by 
the  multiplicative  noise  effect  on  the  data  itself.  This  is  because  the 
phase  rotation  process  is  itself  a  vector  multiplicative  noise  and  is 
absorbed  in  the  multipath  multiplicative  noise  model.  What  this  all  means 
is  that  the  IDEI  error  rate  for  DPSK  can  be  obtained  using  coherent  symbol 
by  symbol  detection  and  decoding  according  to  (39). 

It  should  be  noted  that  a  single  isolated  error  in  detecting  one 
signalling  symbol,  m(j),  produces  a  pair  of  errors  in  the  information 
symbols,  n(j)  and  n(j+l).  If  it  is  assumed  that  IDEI  detection  errors  for 
PSK  occur  independently  and  singly,  then 

PDp$|^(e)  =  2  Pp5|((e)  :  IDEI  detection  (40) 

The  goodness  of  this  assumption  is  tested  below  in  the  section  on  perfor¬ 
mance  results. 

4.  CLOSED-FORM  ERROR  RATES  FOR  STANDARD  DETECTORS 

a.  Coherent  Detection 

In  the  course  of  the  analyses  of  the  error  rate  performance  of 
the  IDEI  detector,  it  was  desired  to  make  comparative  analyses  between  it 
and  standard  detectors,  designed  for  white  noise  interference  only.  It 
was  desired  to  make  these  comparisons  not  only  by  Monte  Carlo  simulations, 
but  also  by  numerical  solution  of  closed-form  expressions  for  the  standard 
error  rate. 

For  binary  phase-shift-keying,  PSK,  there  is  only  one  standard 
detection  technique,  which  is  a  coherent  one.  This  detection  scheme  is 
characterized  as  a  "Correlation  Receiver,"  or  "Matched  Filter".  It  is 
loosely  referred  to  as  an  "Integrate  and  Dump"  detector.  For  binary  fre¬ 
quency-shift-keying,  FSK,  there  are  two  standard  detectors,  one  coherent 
and  the  other  non-coherent.  The  coherent  scheme  is  used  when  there  is  no 


difficulty  in  deriving  a  carrier  phase  reference.  If  carrier  phase  is 
not  assumed  derivable,  then  the  incoherent  FSK  detector  is  used. 

For  high  signal  to  noise  ratios  (low  error  rates)  the  performance  of 
the  coherent  detector  is  about  2.5  dB  better  than  that  of  the  non-coherent 
detector  [11].  For  purposes  of  comparing  the  IDEI  performance  to  standard 
detector  performance  for  FSK,  the  best  standard  detector  is  chosen,  which 
is  the  coherent  one. 

From  [1],  the  sufficient  statistic  for  coherent  detection  is 
T 

I  i  (k)  [i.(k;0)  -  aCk;!)]  (41) 

k=l 

where  ^(k)  and  4(k;m)  are  as  defined  in  (1).  The  decision  rule  is 
m=l 

u  $  0  (42) 

m=0 

The  probability  of  error,  P(e),  for  coherent  detection  is 

P(e)  *  PrlCO  <  o,  m=l]U  [u  £  0,  m=0]>  * 

»  -k/”  p(olm*l)do  +  p(olm=0)du]  (43) 

0 

assuming  that  the  occurrences  of  m=l  and  m=0  are  equally  likely.  The 
density,  p(u|m),  is  Gaussian  and  is  described  by  the  K-sample  conditional 
means  and  variances  of  u. 

Substituting  the  defining  relation  for  z(k),  of  (1),  into  (41)  yields 

k  T 

'^  =  I  [a(k;m)  +  ^(k)  +  n(k)]  [4(k;0)  -  a(k;l)]  (44) 

k=l 

Since  y(k)  and  n(k)  are  zero-mean,  then 

T 

E(u|ral  =  ^  4  (k;m)[4(k;0)  -  4(k;l)]  (45) 

k=l 
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It  is  assumed  that  the  "energy"  of  :i(k;l)  and  4(k;0)  are  equal  so  that 
K  K 

I  J(k;0)4(k;0)  =  J  J(k;l  )a  (k;1 )  (46) 

k=l  k=l 


E{u|m=0}  =  -E{u|m=l}  =  p 


The  variance  is  given  by 


var{u|m}  = 


K  K 


I  i  [i.(k;0)  -  4(k;l)]^  E{[y^(k)  +  n(k)][y(j)  +  n(j)]^} 
j=l  k=l 


Thus,  it  is  seen  that 

var{u|m=0}  =  var{u|m=l}  ^  a’  (49) 

In  (48),  the  expectation  is  the  2x2  autocovariance  of  the  sum  of 
the  I-Q  vectors  of  white  noise  and  colored  noise.  Since  y^(k)  and  n(k)  are 
zero-mean  and  independent,  (48)  may  be  rewritten  as 

K  K 

var{u|m}  ^  I  I  [A(k;0)  -  A('<'>l)]^[Vyy(k-j)  +  V  (k-j)]  • 
j=1  k=l 

[A(j;0)  -  (50) 

where  V^^(k-j)  is  the  2x2  white-noise  variance  given  in  (1).  Assuming 
that  y(k)  is  the  low-pass  I-Q  vector  resulting  from  a  stationary  band-pass 
process,  then  )  has  the  form 


»..(  )  V,  (  n 


V  (  )  = 

yy  -V.  (  )  V 
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iq 

ii(  L 


If  the  continuous-time  bandpass  process  has  a  power  spectrum  which  is 
even-symmetric  about  the  signal  carrier  frequency  (demodulation  reference 


'm 


frequency)  then  )  =  0,  identically.  See  Section  IV  for  details. 

From  the  above,  then,  the  probability  of  error  for  coherent  detection 


IS  given  as 


P(e)  =  ^1  -  erf(-^)] 

i/2a 


where  erf(  )  is  the  tabulated  "error  function".  It  is  desirable  to  write 
P(e)  in  terms  of  the  ratio  E/N^  where  E  is  the  energy  of  the  continuous 
time  signal  waveform  in  one  symbol  period  and  is  the  spectral  density 
of  the  continuous-time  white  noise,  n{t).  The  continuous-time  version  of 
(52)  is 

P(e)  =  1[1  -  erf[/ig^]]  (53) 


where  p  is  the  correlation  coefficient  between  the  two  possible  signal 
waveforms.  For  PSK,  p  =  -1.  For  FSK,  p  =  0.043  for  Aiji  =  0.785.  Thus, 
p  ~  0.  These  results  may  be  obtained  from  the  defining  integrals,  p  = 

E'^  /J4^(t;m=l )4(t;m=0)dt,  where  E  =  /J;6^(t;m=l )4(t;m=l )dt  and  the  4(t;m) 
are  given  in  equation  (33). 

In  order  to  tabulate  results  for  P(e)  as  a  function  of  E/N^,  the  iden¬ 
tity  is  made 

EQr-l  =  _JL  (54) 

2^0  /2o  ^  ^ 

2 

This  leads  to  setting  the  level,  a„,  of  the  white  noise  variance,  V  , 

n  nn 

according  to 

2  ^  S-.L.(A^)-K  ,5  j 

On  voo; 

where  S  is  total  carrier  power,  K  is  number  of  samples  per  symbol,  and 
L(A<ti)  is  a  modulation  loss  factor  of  the  modulation  index,  Ai)-. 


L(A(|i)  =  sin2(A<t>) 


=  2  I  sin2(|^  (k-i)A<t) 
k=l  ^ 


Note  that  by  using  (55),  E/N^  becomes  the  ratio  for  the  actual  signalling 

energy  which,  for  low  index  modulation,  does  not  include  the  energy  left 

in  the  residual  unmodulated  carrier.  Comparison  of  performance  between 

differing  modulation  types  (PSK  or  FSK)  is  done  on  the  basis  of  equal 

2 

symbol  E/N^.  Thus,  the  white  noise  variances,  o^,  may  not  be  equal,  if  the 
modulation  loss  factors  differ. 

Letting  J  denote  the  power  of  the  colored  process  y(k)  (in  band-pass 
form)  and  B,  the  one-sided  equivalent  noise  bandwidth  of  the  low-pass  I-Q 
process,  equivalent  white  spectral  density,  Nj,  for  the  colored 

process  is  defined  by 

J  =  Nj  •  2  Bj  (57) 

Then  the  total  equivalent  white  noise  spectral  density  for  the  standard 
detector  is 

Nt  N  +  N,  (58) 

Tod 

where  N  is  the  usual  white  noise  density. 

0 

The  total  signal  power  S  is  related  to  symbol  energy,  E,  and  S3mibol 
period  T  by 

E  =  S-T-L(A(t>)  (59) 

where  L(a4i)  is  modulation  loss  factor,  defined  in  (56). 


Thus 


and 

E 

^  ■  lI^-t 

(60) 

S  _  E 

J  L(A((>) "T’Nj'Z  Bj 

(61) 

Now, 

B, 

(r>"o  ■  E  =  (f)  ■  •  (2 

0 

(62) 

where  R  is  symbol  rate.  Thus 


N  =  - ^ — p-  •  •  N 

L(M)  .  (f)  'o 


(63) 


and 


Nt  =  N  +  N, 
T  0  J 


R  ■ 

1  +  - c  •  (pg-) 

L(A<^)  .  (J) 


Thus 


t  1  + 


F  =  L(A^).{f).(2 


(64) 


(65) 


Knowing  all  the  quantities  in  F,  (65)  may  be  substituted  for  E/N^  in  (53) 
to  compute  the  standard  coherent  detector  error  rate  when  the  colored  noise 
process  is  of  much  greater  bandwidth  than  the  desired  signal. 

b.  Non-coherent  Detection 

In  order  to  have  a  fair  comparison  between  the  IDEI  and  standard 
detectors  for  DPSK,  it  is  desirable  to  use  a  non-coherent  version  of  the 
standard  detector.  Thus,  it  must  be  determined  whether  a  closed-form 
error  rate  expression  can  be  obtained  for  the  sampled-data,  non-coherent, 
DPSK  standard  detector. 

The  model  for  the  received  data,  ^(k),  is  somewhat  different  that 
that  of  (1).  Here,  the  data  is  described  by 


z.(k)  =  H  4(k;m)  +  y^(k)  +  ji(k) 


(67) 


where  y^(k)  and  £(k)  are  the  noise  terms  of  (1).  The  term  H^  is  a  two-by- 
two  rotation  matrix  given  by 

r  .  -] 


«o  = 


cos<{i  sin* 

0  0 

-sin(|i„  coS(() 

0  0 


(68) 


25 


where  (p  is  taken  to  be  a  uniformly  distributed  random  phase  angle  due 
either  to  the  channel  or  to  a  completely  unknown  detection  phase  reference 
The  modeling  of  <t>  as  a  uniformly  distributed  random  constant  results 
from  the  physical  assumption  that  the  phase  perturbation  on  the  received 
I-Q  signal  components  is  very  slowly  time-varying  with  respect  to  the 
symbol  period. 

For  DPSK,  the  signal  vector  is  given  specifically  by 

r  nr 

I  cos[c(k:m)A(ti]  I  cos(A(j))  j 

i(k;rn)  =  j  =  i  (69) 

'  sin[c(k;m)A(ti]  c(k;m)‘Sin(A(ti)  > 

J  L_  J 

where  Ap  is  carrier  phase  deviation  in  radians  and  c(k;m)  is  the  value  of 
the  square  modulating  waveform,  given  as 


c(k;m)  =  -1  : 


m  =  0 
m  =  1 


Letting  j  denote  the  present  symbol  number  (or  period)  and  j-1  denote 
the  previous  symbol  number,  it  is  seen  that 


[Hq  Aj(k;ni)]  = 


=  cos2{A(t))  +  c  .  1  (k;m)c  .(k;m)sin2(A(ti)  (71) 

J  I  J 

For  the  case  of  no  residual  carrier  where  Atj)  =  tt/Z,  it  can  be  seen  that 
the  expression  of  (71)  has  f'he  value  +1  when  there  is  no  phase  transition 
between  symbols  and  the  value  -1  when  there  is  a  phase  transition.  Thus, 
it  can  be  seen  that  DPSK  can  be  detected  non-coherently  on  a  sampled-data 
basis  by  forming  the  sufficient  statistic 


where  ^j_.|(k)  are  the  data-samples  (2-vectors)  from  the  previous  symbol 
interval  and  ^.(k)  are  the  data-samples  from  the  present  symbol  interval 

J 

The  decision  rule  is 


where  T  is  the  decision  threshold  given  by 


T  =  co%^{h) 


(74) 


Unfortunately,  the  statistic  u  is  not  Gaussian,  due  to  the  cross 
products  between  the  noises  ^(k)  and  n(k)  on  the  previous  and  present 
periods.  The  probability  of  detection  error  for  the  non-coherent  DPSK 
problem  has  only  been  solved  exactly  for  the  continuous-time  formulation 
with  uncorrelated  (white)  noise  [8,  10].  The  exact  closed-form  solution 
for  colored  noise,  as  y(k)  generally  is,  on  a  sampled-data  basis  is  not 
to  be  dealt  with,  further,  here.  Thus,  the  obvious  precision  approach  is 
to  simulate  non-coherent  detection  algorithms  and  obtain  the  exact  error 
rate  performance  of  the  standard  detector  empirically. 

Also  unfortunately,  the  non-coherent  detector  defined  by  the  algo¬ 
rithms  (72)  and  (73)  is  not  recursive.  It  requires  storage  of  received 
data  points  for  an  entire  symbol  period.  A  recursive  algorithm  may  be 
implemented  which  requires  storing  only  one  statistic  from  period  to 
period.  This  is  the  angle-estimating  algorithm,  based  on  [13].  From 
(67)  -  (69),  it  follows  that  in  the  absence  of  noise 


z(k)  = 


,(^)J 


cos[A(ti»c{k;m)  - 
sin[A4cc(k;m)  - 


(75) 


where  use  has  been  made  of  the  fact  that 


sin[A((>*c(k;m)]  =  c(k;m)sin(A4>) 
cos[A<ti*c(k;m)]  =  cos(a<Ji) 


(76) 


Thus,  without  noise 


z  (k) 

=  tan[A(ji*c(k;m)  -  <t>  ] 


(77) 


Now  define  the  discrete-time  version  of  an  "integrate-and-dump" 
matched  filter  as 

M.(K)  =  I  I  z  (k) 

^  k=l  ’ 

M-(K)  =  I  I  2  (k)  (78) 

q  k=l 


Define  a  statistic  for  the  jth  symbol  interval  as 

M.(K)  , 

S(j)  =  arc  tanj 


(79) 


where  denotes  that  M^.(  )  and  Mq(  )  are  computed  during  the  jth 
interval.  In  the  noiseless  case 


S(j)  =  ^<^*Cj(k;m)  -  4>^  :  No  noise  (80) 

Assuming  is  constant  over  two  symbol  periods 

S(j)  -  S(j-l)  =  A<t.[Cj(k;m)  -  Cj_.|(k;m)] 

=  2a4i  :  c.(k;m)  =«  1,  c.  ,(k;m)  =  -1 

V  J  ~  * 

=  -2a<<i  :  c.(k;m)  =  -1,  c._i(k;m)  =  1 

0  vJ  * 

=  0  :  Cj(k;m)  *  c^.  .,(k;m)  =  ±1  (81) 

Thus,  denote  a  test  statistic  over  two  periods  as 

S  =  |S(j)  -  S(j-l)|  -  A<^  (82) 

The  decision  rule  is 


n(j)=l 
•S  ?  0 

n(j)=0 


(83) 
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5.  THE  UNIFORMLY  MOST  POWERFUL  PROPERTY 

In  this  section  it  will  be  shown  that  for  a  broad  set  of  conditions 
it  is  not  necessary  to  identify  the  strength,  or  scale,  of  the  received 
signal,  a(k;m).  From  (1),  the  received  data  is 

z(k)  =  a(k;m)  +  y{k)  +  n(k)  (84) 

where  4(k;m)  is  desired  signal,  is  colored  noise,  and  ji(k)  is  white 
noise.  Now,  the  scale,  or  amplitude,  of  A(k;m)  is  not  known,  A  Priori. 

Only  the  possible  waveforms  of  £(k;m)  for  m  =  0,  1,  are  known  exactly. 

Thus,  the  reference  signals  for  the  optimum  receiver  of  Figure  2  should 
generally  be  a4(k;0)  and  a^(k;l)  where  a  is  the  estimate  of  received  signal 
strength.  It  is  shown  below  under  what  conditions  the  probability  of 
error  is  independent  of  a. 

From  (11)  the  probability  of  error  for  the  IDEI  detector  is  given  by 
P(e)  =  kl  -  erf(-^)]  (85) 

From  Lemmas  2  and  3  of  Appendix  B  it  may  be  shown  that  the  mean,  u, 
and  variance,  a^,  given  in  (7)  and  (8)  and  used  in  (85),  may  be  written  as 

K  y 

u  =  b  y  [e  (k;m=0,  n=1)e  (k;m=0,  n=1 ) 
k=l  ^ 

-  e^(k;m=0,  n=0)e  (k;m=0,  n=0)] 

•6  "''<6 

K  K 

o2  =  4(b2  +  (b')2)  I  I  u  (j-k)[e  (j;m=0,  n=0) 
j=l  k=l  ^ 

-  e  (j;m=0,  n=1 )]^Ce  (k;m=0,  n=0)  -  e  (k;m=0,  n=l)] 

^  ‘O  9 

(86) 

In  (86)  b  and  b'  are  the  diagonal  term  and  super  diagonal  term,  respective¬ 
ly,  of  the  2x2  inverse  variance  matrix  of  the  identified  Innovations 
process  (Vj|  in  (8)).  u^^(j-k)  is  the  diagonal  term  of  the  2x2  pseudo¬ 
innovations  autocovariance  matrix,  u^^(j-k)  is  a  scalar  function. 

The  quantities,  e  (k;m»i,  n=j)  are  the  transient  error  response 
(error  residuals)  of  the  Kalman  (Wiener)  filter  to  a  driving  signal 


Now  denote 


e  (k;m=i,  n=j)  =  e..(k)  (88) 

■4  —  I J 

The  steady-state  Kalman  filter,  which  is  just  a  particular  canonical  form 
of  the  Wiener  filter  is  described  by 

x.  .(k+l|k)  =  **[I  -  G*A]x.  .(k|k-l)  +  **6*  S.  .(k) 

1 J  1 J  I J 

e.j(k)  =  S..(k)  -  Ai.j.(klk-l)  (89) 

x^j(liO)  -  0  V  i,  j  :  zero  initial  conditions 

where  and  G*  are  the  transition  and  gain  matrices,  respectively,  for 
the  identified  Wiener  filter. 

The  solution  to  (86)  is  obtained  as 

x..(klk-l)  =  Y  [**{1  -  G*a)]*^"^"Vg*S  .(f) 

’J  f=l  ’J 


k-1 


-  I  A[$*(I  -  G*A)]'^'^"VG*S..(f)  (90) 

ij  <j  *j 


ik-i-r 


It  is  shown  in  Appendix  B  that  the  quantity  a[<>*(I  -  G*a)]  ”  4>*G* 

has  the  canonical  form 


A[$*(I  -  G*A)]'^'^"^<t*G*  = 


f(k,  i)  f'(k,  t)  I 
i-f(k,  Z)  f(k,  Z) 


(91) 


L 


To  evaluate  (86)  requires  the  signals,  SQQ(k)  and  SQ^(k).  For  binary 
PSK  or  FSK  (coherent),  the  signal  vectors  are 


^(k;m=0) 


Aj(k) 

-4Q(k) 


A(k;m=l ) 


'  4j(k) 

-6g(k) 


where 


ij(k)  =  A  cos(A(Ji) 

=  A  COS(Aa)t|^) 


:PSK 

:FSK 


SQ{k)  =  A  sin(A<ti)  tPSK 

=  A  sin(Aojt|^)  :FSK 


(92) 


(93) 


The  quantities  A(ti  and  Au  are  PSK  phase  deviation  and  FSK  (radian)  frequency 
deviation  respectively.  The  quantity,  tj^,  is  sampled  time  value,  given  by 


t 


k 


(94) 


where  k  is  sample  number,  K  is  number  of  samples  per  symbol,  and  T  is  sym¬ 
bol  duration. 

Then, 

SgQ(k)  =  A(k;m=0)  -  aA(k;n=0) 

pl-a)Aj(k) 

[{l-a)AQ(k)_ 


SQ^(k)  =  A(k;m=0)  -  aA(k;n=l) 
(l-a)4j(k) 
(l+a)Aq(k)_ 


(95) 


It  follows  that 


k-1 


j  4l(k)  -  I  Cf(k,  +  f  (k,  £)4q(£)] 


^g(k)  =  (1-a)  ^ 


£=1 

k-1 


j_4g(k)  -  [f{k,  £)aQU)  -  f  (k.  £)4j(^)]  J 


^l{k) 


k-1 


(l-a)4.(k)  -  I  [(l-a)f(k.  lUJl)  +  {l+a)f' (k,  £)a.(£)] 
1  £=1  ^ 


k-1 


[_(l+a)cfp(k)  -  ^H(l+a)f(k.  lU^U)  -  (l-a)f  (k.  £)4j(£)] 


(96) 


Next,  the  results  of  (96)  are  substituted  into  the  expressions  for  u 
and  a^,  given  in  (86).  These  expressions  are  rewritten  as 


K  K 

,2  =  4(b2  +  (b')2)  |^I^v)^5(j-l<)[ego(j)  -  eg^(j)f  • 


*  ■  %)1 


(97) 


Substituting  (96)  into  (97)  yields  for  the  p-term, 

K  ,  k-1 

y  =  b  );  {4aUg(k)  -  I  f(k,  t)AAZ)'\^  + 
k=l  ^  ^=1  ^ 

k-1  .  .  „ 

+  [  I  f'(k,  ^)aT(^)][4(l-a)4n(k)  +  (3a2  -  4a  +  1 )  • 

£=1  ‘ 

k-1  k-1 

•  I  f(k.  £)an(£)]  -  [  I  f'(k,  £)4n(^)][2a(l-a)a,(k)  + 
£=1  ^  f=l  ^  ^ 

k-1 

+  (3^2  -  2a  -  1)  ^  f(k,  tUAl)  -  4a2  I  f(k.  £)an(^)]} 
^=1  /=!  ^ 


(98) 


The  result  for  a2  is 
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o2  =  4(b2  +  (b')2)(4;2  I  ^  £)yj)) . 

j=l  k=l  ^=l  ^ 

k-1  j-1 

•  {  I  f  (k.  tUAk))  +  {6M)  -  I  f(j,  l)6Jl))  • 

l=\  ^  ^  t=]  ^ 

k-1 

•  (4n(k)  -  I  f(k,  £)4.(^))]}  (99) 

^  ^=1  ^ 

It  may  be  seen  from  (98)  and  (99)  that  in  the  argument  ,  the  a 

/2o 

factors  will  cancel  only  if  f'(k,  t)  =  0,  identically.  This  latter  will 
occur  only  if  the  Wiener  filter  is  structured  in  the  form  where  the  I  and 
Q  states  are  uncoupled.  Note  that  the  restriction  is  not  that  the  I  and  Q 
terms  of  the  colored  noise  process,  y^(k),  be  uncoupled  (spectrum  symmetric 
w.r.t.  signal  carrier  frequency),  but  only  that  the  filter  be  structured 
for  uncoupled  I  and  Q  processes.  In  case  the  j^(k)  process  represented  a 
one-sided  interference  spectrum,  the  uncoupled  Wiener  filter  would  not  be 
optimum  and  some  penalty  would  be  exacted  for  the  additional  white  noise 
admitted  to  the  filter.  However,  in  order  to  retain  the  Uniformly  Most 
Powerful  property,  the  possible  SNR  penalty  must  be  accepted. 

If  It  is  assumed  that  the  Wiener  filter  is  always  structured  for  un¬ 
coupled  I-O  processes,  then  b*  =  0  and  the  dependence  of  the  argument  — 

/2a 

on  b  also  disappears.  Thus,  the  final  argument  becomes 


I  [Uk)  -  I  f(k,  IMDV 
<=^  ^  £=1 


^  -  _  — 

^  I  I  u  r(j-k)[4Q(j)  -  I  f(j,  £)4f,(£)][4„(k)  -  I  f(k,  DaJDI 

j=l  k=l  ^  ^=1  W  W  ^=1  W 


(100) 

Thus,  under  the  conditions  stated,  P(e)  is  independent  of  a.  It  should 

also  be  noted  in  passing  that  the  argument  also  has  no  dependence  on 

/Za 

the  in-phase  signal  component,  4j(k).  This  is  reassuring  since  4j(k)  con¬ 
tains  no  information  concerning  the  message  symbol.  It  should  be  recalled 
that  the  only  reason  for  allowing  4j(k)  f  0  was  to  maintain  an  unmodulated 
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residual  carrier  component  for  anti-multipath  (multiplicative  noise) 
detection. 

Retention  of  the  UMP  property  is  most  desirable,  since  it  alleviates 
what  VMOuld  otherwise  be  a  most  difficult  requirement  to  satisfy,  identified 
tion  of  the  desired  signal  strength  in  the  presence  of  possibly  stronger 
interference.  Use  of  the  UMP  property  may,  however,  conflict  with  identi¬ 
fication  of  the  colored  interfering  process,  depending  on  how  such  identi¬ 
fication  is  implemented.  ML  identification,  which  is  described  in  the 
following  chapter,  is  achieved  by  processing  the  pseudo-innovations,  or 
tracking  error.  With  an  improperly  scaled  signal  waveform  reference, 
a^(k;n),  the  tracking  error  is  perturbed  and  may  cause  error  in  the  ML 
identification.  However,  if  the  ad  hoc  identification  method,  alluded  to 
in  Chapter  IV,  is  employed,  then  UMP-induced  identification  error  may  not 
be  as  significant,  since  detection  error  rate  is  later  shown  to  be  quite 
tolerant  of  ad  hoc  identification  error.  An  exact  characterization  of  the 
identification  error  induced  effects  of  using  the  UMP  property  requires 
further  research  than  has  been  performed  to  date. 

The  UMP  property  was  shown  to  obtain  for  a  class  of  signal  structures 
of  the  form  of  (92).  PSK  and  FSK  happen  to  belong  to  this  class,  as  do 
PAM  signals,  also.  The  requirement  to  implement  the  tracking  filter  in 
uncoupled  form  is  not  critical  since  the  only  effect  is  to  allow  some  ad¬ 
ditional  white  noise  into  the  filter.  The  worst  effect  would  be  a  3  db 
degradation  for  a  truly  single-sideband  interfering  signal. 


SECTION  III 


rWXIflUM  LIKELIHOOD  IDENTIFICATION 
OF  IN-PHASE/QUADRATURE  VECTOR  PROCESSES 
1.  THE  I -Q  CANONICAL  MODEL 

To  examine  the  statistical  relations  for  the  In-phase  and  Quadrature 
low-pass  processes,  consider  the  bandpass  formulation,  thereof.  Define 
a  bandpass  Gaussian  process,  y(t),  as 


y(t)  =  y^.(t)cosaj^t  -  y^(t)sinu)^t  (lOl) 

which  has  power  spectral  density,  Syy((D).  The  power  spectral  density  is  the 
Fourier  transform  of  an  autocorrelation  function,  Vyy(T),  and  is  therefore 
real,  positive,  and  an  even  function  of  to.  However,  note  that  the  density 
need  not  be  locally  symmetric  with  respect  to  the  frequency, 

Now,  y-(t)  and  yq(t)  are  the  low-pass  Gaussian  In-phase  and  Quadrature 
components  of  y(t),  resoectively.  Assuming  that  y(t)  is  zero-mean,  then 
y.(t)  and  yq(t)  are  zero-mean  and  completely  described  by  their  autocorre¬ 
lation  and  cross-correlation  functions,  Vqq(T),  and  For 

y(t)  to  be  stationary  it  is  necessary  and  sufficient  for  [14j 


Vi,.(T)  =  V..(-t)  =  Vqq(T)  =  V^q(-T) 


Vqi(x)  =  V.q(-x)  -  -Vq.(-x) 


(102) 


That  is,  V.j.j('r)  and  Vqq(T)  are  even  functions  and  (t)  is  an  odd  function. 
Note  that  it  is  not  required  for  y^. (t)  and  yq{t)  to  be  orthogonal  (or 
independent) . 

The  power  spectral  densities  for  y^. (t)  and  yq(t)  are  defined  by  the 
Fourier  transforms 


S.  .(oj)  =  F{V.  .(t)} 
tv'  n  ' 

Sq.M  =  F{Vq.(r)}  (103) 
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Since  V..(t)  and  V  (t)  are  real  and  even,  S..(a))  and  S  (u)  are  real,  even, 

I  I  M  »  *  HM 

and  positive.  Since  is  real  and  odd,  Sq^(w)  is  imaginary  and  odd. 

Now,  S.^(a)),  S^q(a)),  and  S^^(ai)  may  be  determined  directly  from  S  (uj) 
by  [15] 

S^.^((ja)  =  S^y(u^+(o)  U  (w^+oj)  +  Sy^(a)-io^)  U  (w^-w) 

Sq^(u)  =  j[Syy(a)-a)^)  U  (u^-as)  -  Syy(u^+u))  U  (oj^+w)] 

(104) 

where  U{  )  is  the  Unit-Step  function  defined  by 
U(x)  =1  ;  0  £  X 

=  0  ;  X  <  0  (105) 

Figure  3  shows  the  various  spectial  relations  from  (104)  for  a  hypotheti¬ 
cal  non-symmetric  bandpass  power  spectral  density.  Note  that  if  S^y(“) 
were  locally  even  symmetric  with  respect  to  the  frequency,  then  S^^(w) 
would  be  identically  zero.  Hence,  ^^^(t)  would  be  identically  zero  (limit¬ 
ing  case  of  an  odd  function).  Thus,  y^(t)  and  yq(t)  would  be  orthogonal, 
uncorrelated,  and  independent  (since  they  are  Gaussian). 

If  y.j(t)  and  yq(t)  were  independent,  they  could  be  identified  indepen¬ 
dently,  using  Single-Input-Single-Output  (SISO)  identification  techniques. 
Unfortunatley,  in  general,  the  Doppler  spectra  or  additive  colored  inter¬ 
ference  spectra  are  not  locally  even  symmetric.  Thus,  in  general,  y^(t) 
and  yq(t)  are  correlated,  and  Multi-Input-Multi-Output  (MIMO)  identifica¬ 
tion  must  be  used. 

For  the  present  problem,  the  I-Q  Generator  Model  is  the  stationary 
version  of  a  linear  discrete-time  invariant  system.  System  parameters  are 
assumed  to  be  constant  or  so  slowly  time-varying  that  they  may  be  taken  as 
constant  for  the  purposes  of  recursive  identification.  This  means  that 
the  elements  are  constant  over  the  interval  of  time  corresponding  to  the 
memory  of  the  identifying  algorithms. 

Thus,  the  1-0  model  is  defined  by  the  equations 

x(k+l )  =  $  £(k)  +  rw(k) 

(continued) 
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(106) 


jj^(k)  =  Ax(k) 
z{k)  =  /(k)  +  n(k) 


Now,  /(k),  ji(k),  z(k),  and  w(k)  are  all  2-vectors.  In  terms  of  the  I-Q 
formulation,  they  are  defined  by 


i^(k)  =1  y.(k)" 


n(k)  = 


z(k)  =  rz.(k) 


n  (k)J 


w(k)  =  w.(k)  ; 

Lwq{k)J 


(107) 


Both  n(k)  and  w(k)  are  independent,  zero-mean,  white  and  Gaussian. 
It  is  assumed  that  y^(k)  and  yq(k)  are  each  Markov-N.  Thus,  the  state- 
vector,  x(k),  must  have  2N  state  (system  order),  and  the  obvious  defini¬ 
tions  follow: 


r*i(k)i 
1  -  -  •• 

$  = 

r  = 


Y  •  •  ^  Y  . 

,  J-iq 


^i  1 


$  .  .  I  il>  . 
n  ,  iq 


(j)  .  '  $ 

_  qi  1  ^qq. 


A  = 


J  '  J' 

A  .  .  I  A  , 

-n  I  -iq 


-qi  I  -qq 


(108) 


where  the  x.(k),  )^(k),  j..,  x-^,  Xq^.  Aii.  Aq,.  and  X^^  are  all 


N-vectors.  The  i'..,  and  $  „  are  each  NxN  matrices, 

i  1  1 q  qi  qq 

The  major  emphasis  of  the  modelling  is  to  find  the  system  parameters 
for  the  colored  radio  frequency  interferences  and/or  the  complex  Doppler- 
spreading  process  so  that  the  system  produces  a  given  output  covariance 
function.  This  system  must  satisfy  three  system  properties. 

(1)  The  stationarity  of  the  I-Q  process. 

(2)  Markov-Gauss  process. 

(3)  Output  statistics 


The  output  covariance  relations  for  the  general  models  are 


k)  =  E{z(k+j)2(k)} 

=  AV^^(k+j,  k)A’^  +  (109) 

where 

'^nn  ”  '’n^2x2'^jk 

From  the  Markov  process,  the  covariance  of  the  state,  V  (k+j,  k)  is  given 
by 

V^^(k+1,  k+1)  =  k)J  +  rr^ 

V^^(k+j,  k)  =  $Jv^^(k,  k)  (110) 

It  may  be  assumed  without  loss  of  generality  that  w(k)  has  unit  variance. 
It  is  assumed  that  the  generator  has  reached  steady-state  and  that  )((k) 
is  stationary.  Under  these  conditions,  equations  (lOS)  and  (109)  become 

v,,(k*j.  k)  ■  t  v„„ 

Now,  the  requirements  of  equation  (102)  are  that  for  y.(k)  and  yq(k)  to  be 
low-pass  I-Q  components,  it  must  be  satisfied  that 


V^2(k+j,  k)  ^  V^^(j) 


Vii(j) 

Vqi^j) 


V. 

iq 


V 

qq 


v..(.j)  =  Vaa(j)  i  an  even  function 

V.q(j)  =  -V.q(-j)  =  -Vq^(j)  ;  an  odd  function 


(112) 


The  canonical  modelling  problem  is  to  choose  a  structure  {r,  $,  A} 
for  the  data  generator  such  that  the  number  of  non-zero  elements  is  minimal. 
So  far  as  realization  of  a  specified  output  autocovariance  matrix  is  con¬ 
cerned,  r  and  a  are  redundant.  That  is,  one  or  the  other  of  r  and  A  may  be 
fixed  and  the  remaining  matrix  varied  to  realize  the  autocovariance.  In 
the  present  model,  a  is  fixed  and  is  therefore  known,  A  Priori.  By  Theorems 
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1,  2,  and  3  of  [16],  the  generator  structure  is  given  by 


$  = 


A 


0 


“  X  '  X 

r  =  -  -  ' - 

-X  :  X 


(113) 


where  x' •  A  ^re  all  N-vectors  and  tj>  and  <()'  are  each  NxN  symmetric 
matrices. 

This  system  structure  was  derived  by  continuous-time  modelling  since 
time  is  a  parameter  in  (101).  This  system  structure  of  (113)  satisfies 
the  continuous-time  model  for  the  stationary  I-Q  process.  The  relation 
between  the  continuous-time  model  and  the  discrete-time  can  be  found  in 
[16]. 

The  system  equations  are  given  as  follows. 


where 


x(k4l)  = 

"4  <1 

-4'  (| 

>1  f:, 

,  x(k)  +  j  . 

U  X 

1 

1 

z(k)  = 

1 

0  1 

)^(k)  +  n{k) 

E{w( i)w(j)}  =  16. j 

E{ri(i)n(j)}  =  a2I6.^. 

E{w(i)M(.i)}  =  0 

for  all  i,  j 

and  4,  and  4'  matrices  are  assumed  to  be 


r*i  1 

I 

0 

<t>2  0 

4'  = 

^2  * 

L  0  ^  J 

0  '*’N' 

>J  =  (1,  1,  ...  1) 


(114) 


(115) 
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Figure  4  shows  the  partially  decoupled  system  where  I  denotes  the 
jutaposition  matrix. 

The  steady-state  Kalman  gain,  6,  and  the  innovation  variance  corre¬ 
sponding  to  this  system  have  the  following  structures,  as  shown  in  Appendix 
B. 

u 

-u'  uj  (116) 

where  and  £'  are  each  N-vectors.  When  the  output  spectrum  is  symmetric, 
then  the  off-diagonal  blocks  of  (112)  and  (115)  are  zeros. 

2.  DERIVATION  OF  THE  MAXIMUM  LIKELIHOOD  ALGORITHM 

Maximum  Likelihood  Estimation  was  introduced  into  statistics  by  R.  A. 
Fisher  in  1906.  It  is  probably  the  most  widely  used  method  for  estimation 
in  statistics.  The  vector  of  unknown  parameters  {4>,  r,  of  the  system 
is  denoted  by  The  maximum  likelihood  estimate  of  B,  given  a  sequence 
of  observations,  z(l),  z(2),  ...,  z(K)  is  given  by 

j  =  max  p(Z(K))_|)  (117) 

1 

where  Z(K)  =  {z(l),  i(2),  ...,  i(K)} 
and 

p(Z(K)i^)  =  conditional  probability  density  function  of  Z_(K) 
given 

(118) 

The  method  of  maximum  likelihood  consists  of  finding  that  value  ^  of  para¬ 
meters  which  is  "most  likely"  to  have  produced  the  data. 

An  expression  for  p(^(K)|^)  is  derived  as 

p(Z(K)|i)  =  p(z(l),  z(2),  ...,  z(K)Ij^) 

=  p(z(K)|Z(K-l),  ^)p(Z(K-l)|i) 

=  p(z(K)|Z(K-l),  j^)p(z(K-l)lZ(K-2),  i)p(Z(K-2) | b) 

K 

=  ’T  p(z(k)|Z(k-l),  i)  (119) 

k=l 


G  = 


a  ;  a' 
-a^  i'  a 


j 
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PARTIALLY  DECOUPLED  SYSTEM 


Figure  4.  Partially  Decoupled  System 


i 


p(z(k) |Z(k-l ) ,  is  Gaussian  since  w(k)  and  n(k)  are  Gaussian  and  the 
generator  is  linear.  Therefore,  the  density  function,  p(z(k) | Z(k-1 ) ,  ^), 
is  completely  characterized  by  the  conditional  mean  and  variance. 

E{z(k)|Z(k-l),  §)  =  z(k|k-l,  b) 

E{[z(k)  -  z(klk-l,  B)][z(k)  -  z{klk-l,  b)]^1Z{K-1),  b) 

=  E{v(k,  B)v''’(k,  b)|Z(K-1),  b)  =  V^^(k,  B)  (120) 

where  v(k,  b.)  =  z(k)  -  z(k|k-l),  b)  .  v(k,  b)  is  the  Innovation  process 
and  V  (k,  b)  denotes  its  variance. 

VV 

The  negative  log-cost  function,  J(l),  can  now  be  written  as 


J(b)  =  -log  p(Z(K)1b) 


The  problem  of  determining  the  ML  estimate  has  now  become  one  of  find¬ 
ing  a  way  of  calculating  the  conditional  mean,  z{klk-l,  p),  and  the  error 

variance,  V  {k,  p) .  The  quantities  can  be  obtained  from  a  Kalman  filter 

vv  — 

State  estimate  given  fiote  that  the  ML  estimation  process  is  identical 
to  the  MAP  detection  strategy  so  that  this  ML  estimation  is  imbedded  in  the 
detection  algorithm.  The  Kalman  filter  algorithm  is  the  following 


X(k|k-1)  =  <f.X(k|k-l) 

(122) 

v(k,  i)  =  z(k)  -  AX(k|k-l) 

(123) 

X(k|k)  =  X(k|k-1)  +  G(k)v(k,  p) 

(124) 

V5^(k|k-1)  =  ♦V5^(k-l|k-l)J  +  rr^ 

(125) 

''vv^'^*  =  AV5^(k|k-l)A^  + 

(126) 

G(k)  =  V5^(klk-l)AVJ^(k,  i) 

(127) 

V^(k|k)  =  (I  -  G(k)A)Vo^(k|k-l) 

(128) 

In  the  steady  state,  equations  (125)  -  (128)  are  also  in  steady  state  and 

a  real-time  computation  is  not  necessary.  Therefore,  the  ML  estimation 

is  to  find  v(k,  p)  which  minimizes  the  cost  function,  J(^),  with  respect 

to  p  since  the  logarithm  is  a  monotonic  function.  This  is  a  very  difficult 

non-linear  problem  because  of  the  constraints  in  the  Kalman  filter  equations. 

In  the  steady-state,  the  filter  gain,  6(k,  p)  and  covariance,  V^^(k,  p) 

have  reached  constant  values  G  and  V  .  The  vector  ^  of  unknown  parameters 

is  now  defined  to  include  G  and  V  instead  of  V  „  and  r  since  the  latter 

vv  nn 

are  subsumed  in  the  former.  Then 

J(l)  =  i  I  l)V"^(k,  p)  +  log|V^,^  1}  (129) 

c,  VV  VV 

where 

^  =  unknown  parameters  in  {$,  G} 

Once  p  is  estimated,  then  r  and  V  may  be  obtained  from  (125)  -  (128)  if 

nn  y 

desired.  When  the  numbers  of  unknown  parameters  in  p  and  in  V  _  and  rr 

—  nn 

are  identical,  it  may  be  possible  to  use  ^  to  solve  for  unique  estimates 

of  the  unknowns  in  V  and  rr^.  Otherwise  it  is  not. 
nn 
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r 


I 


The  cost  function  can  be  minimized  with  respect  to  to  give 


V 

vv 


1  K  .  J  . 
TT  I  v(k,  ^)v  (k,  b) 

k=l 


(130) 


where  jS  is  the  ML  estimate  of  unknowns  of  «>,  G.  Substituting  this  value 
in  cost  function  (129)  we  have 


J(b)  -  -I  log  IV  1  +  constant 

—  d  ‘  vv' 


(131  ) 


This  function  can  be  minimized  using  the  gradient  methods,  referred  to  as 
the  Newton-Raphson  method.  The  seoaration  between  estimating  b  and  V 

vv 

is  not  as  complete  as  in  the  SISO  [17J. 

The  cost  function  has  multiple  maxima,  saddle  point,  discontinuities, 
and  singular  Hessian  in  parameter  space,  in  particular,  a  large  number  of 
unknown  parameters.  The  application  of  the  gradient  method  for  this  diffi¬ 
cult  non-linear  programming  problem  causes  extremely  slow  convergence, 
divergence,  or  convergence  to  a  wrong  stationary  point.  Thus,  good 
initialization  is  important  to  ensure  convergence  to  the  absolute  maximum. 
This  is  analagous  to  the  "acquisition"  problem  for  any  non-linear  tracking 
estimator. 

The  basic  iteration  in  gradient-type  non-linear  programming  methods 
is 

I,*,  =  i,  - -  P,R,a,  (132) 


where  Ai^.  is  the  step  size  and  is  the  unknown  parameter  vector  at  the 
ith  iteration  is  a  vector  of  gradients  of  the  cost  function  J(^),  i.e.. 


3J(l) 


(133) 


R^.  is  an  approximation  to  the  inverse  of  Hessian  matrix: 


3  2J(i) 


91^ 


1-1 

I 

1  =  li  { 


(134) 
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and  p^.  is  a  scalar  step  size  parameter  chosen  to  ensure  that  < 

The  main  differences  between  many  non-linear  programming  schemes 
is  in  selection  of  R.,  and  in  some  cases  p.  and  [18]. 

The  first  gradient  of  the  cost  function,  J(£)  is 


3J(l) 

31 


I  V  (k.  l)V 

k=l 


-1 

VV 


3Ai(l(,  l) 

31 


(135) 


Generally,  the  computation  of  the  Hessian  matrix  is  not  desirable  since 
it  is  very  expensive  to  compute  the  extra  terms  and  may  not  pay  off  in  terms 
of  the  improved  convergence  rate.  Instead  one  chooses  as  the  inverse 
of  the  Fisher  information  matrix  where 


i  32J(i) 

1  f' 

3J(l) 

3J(l)  1 

T 

Mi  =  M - - 

1 

i  31^ 

6  =  e^J  I 

_ 

3lJ 

1 

(136) 


The  expectation  is  taken  over  the  whole  sample  space.  is  a  nonnegative 
definite  symmetric  matrix.  This  technique  is  called  by  modified  Newton- 
Raphson,  quasi inearization.  is  oenerally  estimated  from  the  samples  as 


K 


M.(n,  m)  =  I 
’  k=l 


■3v(k,  e)l 


T 


36(n) 


VV 


3v(k,  e) 
3B(m) 


(137) 


where  6(n)  is  the  nth  component  of  the  B  vector.  A  more  exact  expression 
for  and  M^.  can  be  found  in  [18,  19]  but  in  general  the  extra  calculations 
are  not  worth  the  improvement  in  convergence  rate.  Note  that  the  first 
derivative  J(i)  with  respect  to  6.  is  needed  to  compute  the  approximate 
inverse  of  the  Hessian  matrix.  But  the  Fisher  information  method  has  a 
difficulty  when  M.  is  singular.  To  avoid  this  difficulty,  the  step  size 
A6.  is  decomposed  by 

m  p.  T 

APi  =  I  7^  (u  gjvi  (138) 
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where  is  an  eigenvalue  of  corresponding  to  the  eigenvector  Uj.  It 
can  be  seen  that  the  step  size  in  direction  u.  may  be  very  large  for  small 

A  >J 

Aj.  This  means  that,  when  is  nearly  singular,  the  step  size  takes  large 
steps  in  those  parameter  directions  about  which  the  least  information  is 
available. 

The  rank  deficient  method  is  to  use  a  psedo-inverse  of  M  for  R  as 


R  = 


JL  T 

j?i  “j~j 


(139) 


where  A.  are  the  eigenvalues  of  M  and  are  the  corresponding  eigenvectors 

such  that  A,  >  A.  >...>A  ,  >  b  >  A  >-.->A„  and  b  is  a  suitably  chosen 

1  2  m-k  m-K+i  m 

threshold  value. 

Numerically,  better  accuracy  is  obtained  by  modifying  (132)  as 


^i+1  “  ^i 


m-k  ^ 

=  3^  -  P  I  -T— ^  u.- 


j  =  l 


-j 


(140) 


It  is  difficult  to  find  a  proper  value  for  p  and  eigenvalue  threshold  b. 
Mehra  [19]  has  suggested  a  modified  rank  deficient  method  but  there  are 
no  general  rules  to  determine  a  proper  b  value,  in  particular,  for  a  large 
number  of  unknown  parameters.  Experimentally,  when  the  initial  values  are 
far  from  true  values,  b  may  be  large  enough  to  prevent  the  estimator  from 
diverging. 

Now,  useful  computational  steps  for  the  gradient  are  obtained  through 
the  "state  sensitivity"  for  parameter  6. 

Consider  the  following  steady-state  Kalman  filter  equations: 


X(klk-l)  =  oX(k-l|k-l) 

(141) 

v(k)  =  z(k)  -  AX(k|k-l) 

(142) 

X(k|k)  =  X(k|k-1)  +  r,v(k) 

(143) 

The  gradient  of  v(k)  with  respect  to  (j  =  1 , 
sequentially  from  (141)  -  (143)  as 


. . . ,  N)  can  be  obtained 


X(k-1  |k-l) 

^  /n  .  V4  (ft  -  ' 


3v(k)  _ 


(145) 


3X(klk)  =  (I  _  r.N  3X(klk-1) 


where  ifj  is  an  unknown  parameter  of  4*  matrix.  So  is  the  gradient  of  v(k) 
with  respect  to  g .  ( j  =  1 ,  2,  . . . ,  N)  given  by 

J 


3X(k|k-l) 


3v(k)  ^  3X(k|k-1) 


=  (I  -  Ga) 


(147) 


(148) 


(149) 


where  g^.  is  an  unknown  parameter  of  G  matrix.  Equations  (14  7)  -  (149) 
should  be  processed  simultaneously  and  sequentially  to  solve  the  gradient 
of  v(k)  with  respect  to  B.  Note  that  the  number  of  unknown  parameters  are 
2N  which  is  a  minimum. 

For  stationary  I-Q  process,  the  gradient  of  J(^)  with  respect  to  ^ 
is  simplified  as 

3J(b)  K  8v(k) 

- =  I /(k)V' 

33  k=l 


K  3v,(k)  3v,(k) 

I^[v^(k)u  -  V2(k)u']  - V2(k)u]  — — 

(150) 


where 


v(k)  -  i 


!  ^1 (k) 

-1 

V  '  =1 

and 

l_v2(k)J 

(-V)'  V 

The  Fisher  information  matrix  is 
M(n,  m)  =  y  I  MH  i  ^ 


K  r3vi(k)  3v2^^‘^  , 


kli  i 


"  ■  3 


3v|  ( k) 
~3fiW 


3v'](k)  3v2^^^ 


36(n)  ^  *  36(n) 

When  the  system  is  decoupled,  then  (150)  and  (151)  may  be  reduced  as 


3v2( 

TeW 


(151) 


and 


or 


and 


3J(6)  K  r 

"  -  I 

k=l 


36 


\)^(k) 


3^*1  ( k) 


3\>,(k) 


1 


36  ^  31  J 


M(n,  m)  =  u  y 

k=l  L 


‘3v^(k)  3v^(k)  3v2(k)  3v2(k)“l 

3^6 (nj  36(m)  ^  ~3B(n)  3b('") 


3v^(k) 


K  3vi(k)  3vi(k) 


(153) 


We  may  have  some  insight  about  the  decoupled  system  and  verify  the  innova¬ 
tion  variance  structure.  Fortunately,  in  the  estimate  of  u  it  is  not  nec¬ 
essary  to  compute  (140)  in  the  case  of  the  decoupled  system  or  (2x2)  system 
since  it  is  cancelled  in  (140).  Otherwise,  the  innovations  variance  should 
be  estimated  first  with  a  good  initialization  value  and  used  in  (140 ). 
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The  computational  steps  for  the  ML  estimation  are  as  follows: 

(1)  Assume  inition  conditions,  p^,  and  X(0|0) 

(2)  Compute  v(l<)  =  z(k)  -  AX(k|k-l)  for  k  =  N+1 ,  ....  N+M 

(3)  Compute  cost  function  associated  with  a  priori  parameter  estimate 

J(Bi)  =  j  [  I  v'{k)V  'v{k)  +  loo  |V  |] 

^  i  v\r-  '  vv 

(4)  Evaluate  the  sensitivity  function  sequentially  and  simultaneously 
after  M  measurement  and  store  these 


8_v(k) 


3X(k  k-1) 


where 


+  ||  X(k|k-1)  +  z(k-l)  (154) 


F  =  $[1  -  Ga] 

D  =  $G 

(5)  Compute  the  gradient  of  J{^) 
=  y  v(k)V  ^  -- — 

91  k4+r 


(155) 


(6)  Compute  the  information  matrix 

M{i,  j)  =  T  ^ 

k=N+l  vv  1^  a  3  J 


(156) 


(7)  Compute  eioenvalues  and  eigenvector  of  M  (x^  >  x^  >...>Xpj^) 

(8)  Determine  the  threshold  value  for  eigenvalue  x  (x,  >...>x  > 

m  l  m 

(9)  Compute  Rank  deficient  method 


m  uTg . 

=  1,  -  j, 

\J  '  J 


(157) 


(10)  Adjust  the  scalar  p^  to  satisfy  J{b.^^)  <  J(b^) 

(11)  Initialize  X(k|k)  and  to  go  to  step  (2) 


In  step  (7),  many  of  the  computational  difficulties  with  the  rank 
deficient  method  are  involved  with  the  large  spread  in  the  eigenvalues  of  M. 
To  avoid  this  inaccurate  choice  of  in  step  (8),  Mehra  [19]  has  suggested 
that  with  a  proper  choice  of  X^,  steps  (9)  -  (10)  are  done  and  the  cost 
function  value  is  computed.  This  same  procedure  is  repeated  until  m  =  2N 
and  a  ^  is  obtained  producing  a  minimum  cost  function  value.  This  is  called 
the  sweep  rank  deficient  method.  Experimentally,  when  the  number  of  unknown 
parameters  is  small,  then  Mehra's  method  improves  the  convergence  rate. 

But,  with  a  large  number  of  unknowns,  this  method  does  not  work  because  of 
the  large  spread  of  eigenvalues.  Instead,  fixing  a  threshold  value  for  x^ 
is  better  even  though  the  convergence  rate  is  slow. 

If  the  new  cost  is  larger  than  the  previous  cost,  the  step  size  is  cut 
in  half,  setting  p.  in  half  in  step  (10).  This  same  procedure  is  repeated 
a  given  number  of  times.  The  reason  for  this  step  size  cutting  is  the  non¬ 
quadratic  nature  of  the  cost  function.  Also,  the  constraint  boundaries 
for  system  stability  are  adapted  to  restrict  the  $  matrix. 

The  values  of  X(k|k)  and  are  stored  to  be  initialized  for  the 
next  M  measurements. 

To  escape  from  the  computation  loop,  the  gradient  of  J(£)  is  used 
instead  of  testing  the  whiteness  of  the  innovation  process,  which  is  fre¬ 
quently  used  by  many,  since,  in  practice,  the  whiteness  test  may  be  ill- 
conditioned. 

3.  ESTIMATION  PERFORMANCE  OF  THE  M-L  IDENTIFICATION  ALGORITHMS 

In  this  example,  the  actual  system  is  given  by 

X(k+1)  =  $X(k)  +  rw(k) 

2(k)  =  AX(k)  +  n(k)  (158) 
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where  the  numerical  values  are 


1  0 

A  = 

_0  1_ 

n  d] 

^  =  E{n(i)n(j)}  =  1.58  E{w(i)w(j)}  =  16..  (159) 

nn  nil  'J 


The  true  Kalman  gain,  G,  for  (159) 


and  the  true  innovation  variance,  is  given 


V 


vv 


“6.45171 

0 


0 

6.45171_ 


For  the  (2x2)  coupled  system,  the  Kalman  gain  and  the  innovation  variance 
are  decoupled. 

Given  initial  values  as 


the  number  of  samples,  K,  is  varied  100,  500  and  800. 

The  following  Figures  show  the  convergences  for  these  three  cases. 

As  we  can  see  in  Figures  5  -6  ,  the  convergence  of  the  Kalman  gain  is  more 
sensitive  to  the  initial  guesses  than  the  transition  matrix.  It  will  be 
shown  later  in  a  (6x6)  decoupled  case  that  accurate  initialization  is  re¬ 
quired  for  the  Kalman  gain  to  ensure  convergence.  In  Figure  6  ,  the  greater 
K  becomes,  the  smaller  deviation  the  innovation  variance  has.  The  calcu¬ 
lated  'j'  for  K  =  800  is  closer  to  zero  than  K  *  100.  The  cases  of  K  =  500 
and  K  =  800  produce  little  difference  in  convergence. 
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No.  of  Iterations 

CONVERGENCE  OF</i 


Figure  5.  Identification  Convergence  for  Transition  Matrix 


.613064 
True  Value 


No.  of  Iterations 

CONVERGENCE  OF  v 


Figure  6.  Identification  Convergence  for  fiain  and  Innovations  Variance 
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Next,  a  (6x6)  decoupled  case  is  considered  for  K  =  100  and  K  =  400. 
As  previously  mentioned,  the  decoupled  system  can  be  considered  as  a  SISO 
system  in  terms  of  identification. 

Consider  the  (3x3)  SISO  system  as 


X,.(k+1)  = 

i}il  0  0 

0  4,2  0 

i,(k)  * 

^1 

^2 

z{k)  =  (1, 

0  0  412 

l,l)X.(k)  +  n 

.(K) 

^3 

— 

where 


*1  " 

.927374 

4*2  = 

.881911 

.777768 

^1  = 

1.11439 

^2  = 

-1 .40932 

^3  " 

.303111 

a  = 

.499801 

V 


w^.(k) 


(160) 


The  true  Kalman  filter  is  calculated  as 


=  1.27345 

92  =  -1.22638 

93  =  .147568 

NSPB  =  10 
TB  =  1  E-04 
BW  =  2745 
ENOPB  =  10  DB 
SFRDB  =  0  DB 


Its  signal-to-noise  ratio  is  2.0016.  Initial  values  are  given  by 


=  .75 
9*  =  1.15 
g|  =  -1.3 
g*  =  .05 


The  following  tables  are  the  convergence  rates  for  this  case. 

TABLE  2 

CONVERGENCE  OF  -j.  ’ 


Number 

Iteration 

*1  = 

.927374 

<^2  = 

.881911 

^3  " 

777768 

K  =  100 

K  =  400 

o 

o 

o 

c 

If 

K  =  100 

o 

o 

II 

20 

.931523 

.935041 

.895041 

.897619 

.760655 

.767604 

40 

.924770 

.926946 

.888993 

.886991 

.763505 

.768910 

60 

.924573 

. 927804 

.887979 

.888393 

.764136 

.769145 

80 

922456 

.927717 

.885366 

.887378 

.764860 

.769262 

100 

,921746 

.928777 

.883289 

.888936 

.765356 

.769461 
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TABLE  3 

CONVERGENCE  OF  G  AND  V 

vv 


Number 

Iteration 

g^  =  1.27345 

g^  =  -1.22638 

=  .147569 

u  =  .310170 

K  =  100  K  =  400 

K  =  100  K  =  400 

K  =  100  K  =  400 

K  =  100  K  =  400 

20 

1.24253  1.25424 

-1.20901  -1.19561 

.120113  .132448 

.350336  .298245 

40 

1.25845  1.25510 

-1.19354  -1.19486 

.132420  .131805 

.320628  .315488 

60 

1.26415  1.25776 

-1.18818  -1.19220 

.136563  .134330 

.339504  .309749 

80 

1.26660  1.25737 

-1.18578  -1.19261 

.138356  .133823 

.264868  .352092 

100 

1.26826  1.25984 

-1.18420  -1.19015 

.139419  .136201 

.342379  .299879 

Again,  is  observed  the  sensitivity  of  the  Kalman  gain  initial  value. 
Experimentally,  for  a  good  Kalman  gain  initial  value,  the  transition  ini¬ 
tial  value  is  not  overly  critical.  When  the  Kalman  gain  is  large,  this 
dominates  the  sample  space  in  calculating  and  M.  When  the  Kalman  gain 

is  too  small,  it  is  difficult  for  the  estimates  to  converge  to  the  absolute 
minimum  value.  Without  good  initial  values,  it  is  better  to  set  a  large 
eigenvalue  (10^  10^  in  (3x3)  case)  for  the  threshold  and  use  the  rank 

deficient  method  instead  of  the  sweep  rank  deficient  method. 


SECTION  IV 


RESULTS 

1.  SIMULATION  VERSUS  CLOSED-FORM  ERROR-RATE  RESULTS  FOR  PSK  AND  FSK 


The  development  of  the  Monte  Carlo  simulation  for  PSK  and  FSK  in  color¬ 
ed  multiplicative  or  colored  additive  noises  was  performed  in  Phase  I  of 
the  present  contract  and  was  reported  in  [1].  However,  minimal  simulation 
results  were  reported  therein.  Those  six  figures  are  repeated  here  for 
completeness  and  because  of  their  relation  to  the  present  work. 

Figure  7  shows  the  comparison  of  Monte  Carlo  results  with  closed-fomi 
results  for  PSK  in  white  noise  only.  This  curve  verified  that  the  Monte 
Carlo  simulation  routine  was  operating  properly. 

Figure  8  shows  the  variation  of  Monte  Carlo  error  rate  for  PSK  in 
275  Hz.  colored  noise  as  a  function  of  modulation  index.  This  curve  showed 
that  the  transmitted  signal  must  have  a  residual  unmodulated  carrier  compo¬ 
nent  to  enable  the  IDEI  detector  in  colored  multiplicative  noise. 

Figures  9  and  10  show  Monte  Carlo  results  for  PSK  and  FSK,  respectively, 
in  heavy  multiplicative  noise.  The  cases  were  set  as  though  the  diffuse 
multipath  reflection  were  equal  in  strength  to  the  direct  path  (MPR  =  0  dB). 
For  these  cases  any  additive  colored  interference  was  essentially  removed 
(SJR  =  53  dB).  These  results  were  analyzed  in  [1]  and  [12].  The  expected 
3-dB  difference  in  white-noise  only  E/N^  performance  [20]  is  due  to  the 
different  values  of  correlation  coefficient,  p,  in  (53). 

Figures  Hand  12  show  a  comparison  of  Monte  Carlo  and  closed-form 
results  for  PSK  and  FSK,  respectively,  in  colored  plus  white  additive  inter¬ 
ference.  Here  the  Monte  Carlo  results  are  plotted  against  the  closed-form 
solid  curves.  In  the  FSK  case  the  standard  detector  was  noncoherent  in  the 
simulation,  while  the  solid  curve  is  for  a  standard  coherent  detector. 

These  results  were  analyzed  in  [1]  and  [12]. 

Figure  13  is  the  first  set  of  results  not  previously  documented.  Here, 
PSK  is  subjected  to  strong  narrow-band  additive  colored  interference  plus 
white  interference.  The  ratio  of  colored  interference  to  desired  signal  is 
23  dB  (SJR  =  -23  dB).  The  error  rate  is  plotted  versus  signal  energy  per 
symbol  to  white  noise  spectral  density  (E/N^).  The  ratio  of  interference 
bandwidth  to  symbol  rate  is 
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Figure  7.  Simulated  Error  Rate  Check  Case 
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Figure  8.  Minimization  of  Error  Rate  Versus  Modulation  Index 
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Figure  9.  Simulated  PSK  Error  Rate,  Multiplicative  Noise 
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Figure  10.  Simulated  FSK  Error  Rate  -  Multiplicative  Noise 
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Figure  11.  Simulated  PSK  Error  Rate  -  Colored  Additive  Interference 


The  simulated  results  are  plotted  next  to  the  closed-form  solid  curve. 

Note  that  the  discrepancy  between  simulated  and  closed-form  results  here 
amounts  to  1-2  dB  of  signal  to  white  noise  ratio,  or  a  factor  of  5-6  in 
error  rate.  The  explanation  is  that  when  the  ratio  of  colored  interference 
to  desired  signal  becomes  quite  large  (SJR  =  -23  dB),  the  detection  errors 
are  no  longer  independent  and  isolated.  Rather,  detection  errors  occur 
in  "bursts"  of  5  to  7.  This  is  a  consequence  of  improper  decision-directed 
re-initialization  of  the  tracking  filters  after  a  single  detection  error. 

In  Figure  13,  the  standard  detector  error  rate  was  0.5  and  was  not  plotted. 

In  Figure  14,  the  Monte  Carlo  and  closed-form  results  are  compared 
for  the  IDEI  detector  for  FSK  in  heavy  additive  colored  plus  white  inter¬ 
ference.  Again,  the  agreement  between  closed-form  and  simulation  is  good. 
However,  the  poor  performance  of  FSK  in  Figure  14  relative  to  PSK  in  Figure 
13  is  surprising.  This  is  the  difference  alluded  to  in  Section  II. 2.,  on 
page  18  .  Figure  15  shows  a  similar  FSK  run  for  SJR  =  -20  dB  with  the 
standard  FSK  detector  closed-form  and  simulation  results  also  plotted.  It 
is  apparent  that  the  FSK  results  are  valid.  However,  the  difference  between 
PSK  and  FSK  results  is  not  explainable  on  the  basis  of  signal  and  noise 
spectra,  as  noted  in  section  I I. 2. 

Figures  16,  17,  and  18  show  the  qualitative  relationships  between  the 
PSK  and  FSK  signal  spectra  and  the  colored  noise  spectra.  In  Figure  16  is 
shown  the  PSK  spectrum  (low-pass)  for  a  2500  symbol  per  second  signal. 
Superimposed  are  narrow-band  and  full-band  colored  noise  spectra  for  SJR  = 

-5  dB.  The  noise  bandwidths  are  275  Hz  and  2744  Hz,  respectively,  which 
yield  bandwidth  to  symbol  rate  ratios  of  BW/BR  =  0.109  and  BW/BR  =  1.09, 
respectively.  As  detailed  in  [1],  the  colored  noise  is  generated  from  a 
filter  having  three  real  poles  and  one  real  zero  (in  the  s-plane).  Any 
desired  noise  bandwidth  is  obtained  by  simply  scaling  the  poles  and  zeros 
by  the  same  factor.  The  colored  interferences  used  in  Figures  9-15  had  the 
spectral  shape  of  the  narrow-band  noise  shown  in  Figures  16  and  17.  It  is 

shown  in  Figure  16  that  this  type  of  colred  interference  decays  in  frequen- 

4  2 

cy  as  1/f  ,  whereas  the  PSK  spectrum  decays  as  1/f  . 

In  Figure  17  is  shown  the  FSK  signal  spectrum  corresponding  to  the 

2 

model  of  equation  (33).  This  spectrum  also  decays  as  1/f  . 
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Figure  18.  Spectra  of  PSK  and  Full -band 
Colored  Interference  of  the  Second  Kind 


In  Figure  18  is  shown  a  second  type  of  available  colored  interference 
spectrum.  This  spectrum  is  synthesized  by  using  3  real  poles  and  2  imag¬ 
inary  zeroes  (in  the  s-plane).  The  resulting  null  in  the  interference 
spectrum  was  placed  coincident  with  the  first  null  in  the  PSK  signal  spec¬ 
trum.  The  interference  spectrum  decays  at  the  same  rate  as  the  PSK  spec- 
2 

trum,  i.e.,  as  1/f  .  It  was  hypothesized  that  such  an  interference  spec¬ 
trum  would  be  a  "worst  case"  for  a  PSK  signal. 

Figure  19  shows  IDEI  results  for  PSK  and  FSK  in  fullband  interference 

4 

of  the  first  kind,  which  decays  as  1/f  .  Here  the  colored  interference 
was  as  in  Figure  16  with  a  strength  20  dB  greater  than  that  of  the  desired 
signal.  Again  the  comparison  of  Monte  Carlo  and  closed-form  results  is 
good,  under  the  observation  that  the  IDEI  errors  are  occurring  in  bursts. 

2.  IDEI  CLOSED-FORM  PERFORMANCE  FOR  PSK  IN  COLORED  INTERFERENCE  WITH 
PERFECT  IDENTIFICATION 

At  this  point  in  the  investigation,  it  was  decided  to  devote  the  re¬ 
maining  time  and  resources  to  an  in-depth  examination  for  one  signal  type 
and  one  interference  type.  The  signal  chosen  was  PSK.  The  concentration 
on  additive  colored  interference  rather  than  multiplicative  interference 
was  implied  by  two  factors.  First,  behavior  of  the  IDEI  detector  for  multi¬ 
plicative  noise  has  been  rather  thoroughly  investigated  previously,  as  re¬ 
ported  in  [3].  Also,  the  initial  results  presented  in  Figures  9  and  10 
for  PSK  and  FSK  were  not  qualitatively  different  than  those  in  [3]  for  a 
hybrid  PSK-FSK  4-ary  modulation.  Second,  the  results  for  additive  colored 
noise  are  of  great  interest  in  the  context  of  radio  jamming. 

Figure  20  shows  the  first  closed-form  results  for  IDEI  error-rate  for 
PSK  in  additive  colored  plus  white  noise.  Here,  error  rate  is  plotted 
versus  a  normalized  colored  interference  bandwidth.  The  abscissa  is  the 
ratio  of  colored  interference  (equivalent)  noise  bandwidth  to  symbol  rate. 
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Figure  20.  IDEI  and  Standard  Error  Rates  Versus 
Normalized  Interference  Bandwidth,  With  E/N^  as  Parameter 


in  decibels  (10  log^Q(*)).  A  family  of  IDEI  curves  is  plotted  with  E/N^ 
as  parameter.  The  ratio  of  colored  interference  to  desired  signal  power  is 
20  dB  (SJR  =  -20  dB).  The  performance  for  the  standard  PSK  detector  is 
also  plotted  for  comparison. 

Figure  20  shows  three  general  results  of  considerable  interest.  First, 
there  is  a  worst  case  colored  interference  bandwidth  which  maximizes  the 
error  rate  for  each  value  of  E/N^.  Second,  the  worst  case  maximum  error 
rate  decreases  and  the  worst  case  bandwidth  increases  with  increasing  E/N^. 
Third,  for  a  given  value  of  E/N^,  the  IDEI  detector  error  rate  converges 
to  that  of  the  standard  detector  as  the  colored  interference  bandwidth 
increases. 

An  obvious  inference  to  be  drawn  from  Figure  20  is  that  the  IDEI 
detector  provides  the  most  "gain"  over  a  standard  detector  when  the  colored 
interference  is  narrow-band  compared  to  the  desired  signal.  A  second 
inference  is  that  under  mini-max,  or  worst  case,  conditions,  the  IDEI  detec¬ 
tor  still  provides  some  gain  over  a  standard  detector.  Two  subsidiary 
figures,  derived  from  Figure  20,  illustrate  these  points. 

In  Figure  21  is  plotted  the  IDEI  error-rate  performance  versus  E/N^ 
for  PSK  subject  to  20  dB  colored  interference  having  normalized  bandwidth, 
BW/BR  =  1/5.  For  each  IDEI  error-rate  point  plotted  in  21  it  may  be  deter¬ 
mined  from  20  what  value  of  BW/BR  is  required  for  the  standard  detector  to 
yield  an  equal  error  rate.  Thus,  the  required  spectrum-spreading  factor  is 
determined  and  plotted  in  Figure  21.  For  BW/BR  =  1/5,  it  is  seen  that  the 
IDEI  detector  yields  the  same  performance  as  would  be  obtained  from  a  stan¬ 
dard  detector  using  spectrum-spreading  by  a  factor  of  10^  -  10^  for  error 
rates  of  10"^  -  10"^. 

In  Figure  22,  the  worst-case  IDEI  error-rates  are  plotted  versus  E/N^. 
Each  IDEI  error-rate  point  corresponds  to  a  unique  value  of  BW/BR.  The 
corresponding  standard  detector  error-rate  points  are  also  plotted.  It  is 
seen  that  even  under  worst  case  conditions  the  IDEI  detector  has  a  10  dB 
advantage  over  the  standard  detector  in  terms  of  white  noise  E/N^  ratio. 

For  information  purposes,  the  worst  case  bandwidth  for  the  colored  inter¬ 
ference  is  plotted  versus  E/M^.  This  plot  shows  that  the  worst  case  inter¬ 
ference  bandwidth  for  the  IDEI  detector  is  always  considerably  greater  than 
the  desired  signal  bandwidth.  The  converse  is  true  for  the  standard  detec¬ 
tor,  for  which  the  worst  case  interference  is  narrow-band.  These 
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observations  are  based  on  the  assumption  that  the  interference  source  does 
not  possess  the  sophistication  to  generate  a  spectrum  which  duplicates  the 
signal  spectrum. 

Figure  23  shows  the  results  of  the  first  attempt  to  evaluate  the  per¬ 
formance  for  colored  additive  noise  of  the  second  kind,  whose  spectral  shape 
was  shown  in  Figure  18.  It  is  known  that  the  observed  saturation  of  the 
error-rate  versus  E/N^  occurs  when  there  is  an  unmodelled  disturbance  pre¬ 
sent  which  has  not  been  included  in  derivation  of  the  detection  algorithm. 

It  was  hypothesized  that  the  unmodelled  disturbance  was  aliasing,  due  to 
the  considerable  high  frequency  content  of  the  colored  interference.  Thus, 
the  case  for  SJR  =  -5  dB  was  rerun  with  sampling  rate  increased  by  a  factor 
of  10.  The  results  are  shown  in  Figure  24,  confirming  aliasing  as  the  un¬ 
modelled  disturbance. 

In  Figure  25,  IDEI  results  are  plotted  for  PSK  subject  to  both  types 
of  full -band  colored  interference  with  SJR  =  -20  dB.  The  better  performance 
resulted  for  the  full  band  interference  spectrum  with  BW/BR  =  1.09  which 
decayed  as  l/f**.  The  worse  performance  resulted  for  the  interference  spec¬ 
trum  which  decayed  as  l/f^.  It  is  not  known  whether  or  not  the  slight 
indication  of  saturation  for  45  dB  <  E/N^  is  due  to  aliasing. 

Figure  26  shows  the  results  of  the  first  attempt  to  evaluate  the  IDEI 
error-rate  as  a  function  of  the  ratio  of  colored  interference  to  desired 
signal  power  (SJR).  Families  of  curves  were  plotted  with  normalized  inter¬ 
ference  bandwidth  (BW/BR)  as  parameter.  For  each  value  of  BW/BR  a  different 
value  of  E/N^  was  used.  This  was  because  certain  combinations  of  BW/BR, 
E/N^,  and  SJR  caused  the  solutions  on  the  16-bit  minicomputer  to  become 
numerically  unstable. 

It  was  found  that  when  cases  were  run  where  the  ratio  of  interference 
power  to  white  noise  power  (in  the  interference  bandwidth),  J/N,  was  greater 
than  60  dB,  the  numerical  computer  solution  became  unstable  on  the  16-bit 
PDP  11/40.  This  did  not  occur  on  the  60-bit  CDC-6600.  However,  it  was 
decided  to  limit  the  runs  to  conditions  for  which  J/N  <  60  dB.  The  ratio, 
J/N,  is  related  to  the  other  parameters  as 


(161) 
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Interference  of  the  Second  Kind 


In  (161),  L(A(ji)  is  the  modulation  loss  defined  in  (56). 

In  Figure  26,  the  values  of  E/N^  used  were  those  required  to  set  J/N  = 
60  dB  when  SJR  =  -35  dB.  Under  these  conditions,  it  appears  that  the  error 
rate  performances  of  both  the  standard  and  optimum  detectors  increase  as 
the  colored  interference  bandwidth  becomes  greater.  However,  this  apparent 
performance  increase  is  illusory  and  does  not  occur  if  E/N^  is  held  constant 
as  per  Figure  20. 

Figures  27  through  30,  inclusive,  show  a  series  of  four  families  of 
error-rate  curves  for  standard  and  IDEI  detectors.  Each  figure  contains 
results  for  four  values  of  normalized  interference  bandwidth,  BW/BR  =  0.109, 
1.09,  10.9,  and  109.,  respectively.  From  figure  to  figure,  E/N^  is  varied 
in  10  dB  steps,  from  17  in  Figure  27  to  47  in  Figure  30. 

Note  that  in  Figures  27  through  30,  the  standard  detector  performance 
is  the  same.  This  is  because  the  standard  detector  error  rate  is  dominated 
by  the  colored  interfering  process,  rather  than  the  white  noise.  The  IDEI 
error-rate  performance  is  seen  to  vary  from  figure  to  figure,  depet-.aing  on 
E/N^.  The  general  trend  displayed  is  that  the  high-frequency  tracking 
performance  of  the  IDEI  detector  becomes  better  as  E/N^. increases.  In  all 
cases  the  IDEI  detector  performs  better  than  the  standard.  However,  for 
a  particular  value  of  colored  interference  bandwidth,  the  margin  of  perfor¬ 
mance  of  the  IDEI  over  the  standard  detector  is  a  function  of  E/N^. 

Another  method  for  comparing  the  performances  of  the  IDEI  and  standard 
detector  is  to  hold  constant  the  ratio  of  colored  interference  power  to 
white  noise  power  in  the  bandwidth,  1/T  =  BR,  of  a  filter  matched  to  the 
desired  signal.  The  ratio,  JT/N^,  is  related  to  the  other  parameters  as 


(162) 


Figure  31  shows  the  results  for  four  values  of  normalized  bandwidth 
for  the  quantity  JT/N^  held  constant  at  a  value  of  70  dB.  This  shows  rather 
clearly  the  SJR  performance  of  the  IDEI  detector  vis-a-vis  the  standard 
detector  as  a  function  of  colored  interference  bandwidth. 
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Figure  30.  IDE-I  and  Standard  Detector  Performance 
Versus  SJR  for  E/N^  =  47  dB 
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Comparing  (161)  and  (162)  It  Is  evident  that 


N  *  BW7M 

Now,  It  was  conjectured  that  the  error-rate  performance  of  the  IDEI  detec¬ 
tor  Is  controlled  by  the  ability  of  the  filter  to  track  the  colored  Inter¬ 
ference  In  white  noise.  Hence,  the  error-rate  should  be  a  function  of  J/N. 
Since  (163)  shows  that  J/N  Is  a  ratio  of  JT/N^  and  BW/BR,  the  same  error- 
rate  should  be  obtained  so  long  as  the  ratio  Is  maintained  constant.  To 
demonstrate  this  empirically,  the  cases  shown  In  Table  (4)  were  computed. 

TABLE  4 

P(e)  INVARIANCE 


SJR  dB  1  -16 

-16 

-16 

-16 

HB 

42 

37 

32 

27 

lEBHDSI 

mtmm 

nSHDEBI 

HREHI’ 

3.46 

1.09 

0.346 

0.109 

JT/Nq  dB 

55 

50 

45 

40 

P(e) 

It  Is  seen  from  Table  4  that  over  a  wide  range  of  normalized  bandwidth, 
it  Is  J/N  which  controls  the  error-rate,  P(e).  Some  computational  advan¬ 
tage  may  be  gained  from  this  result  by  realizing  that  results  for  greater 
values  of  BW/BR,  which  normally  require  more  samples  per  computation,  may 
be  obtained  by  fixing  BW/BR  and  reducing  JT/N^^. 

Two  final  sets  of  error-rate  results  for  perfect  Identification  were 
obtained  for  colored  Interference  of  the  second  kind  which  decays  as  l/f^. 
In  Figures  32  and  33  are  plotted  the  error-rate  results  versus  SJR  for  the 
IDEI  and  standard  detectors.  In  Figure  32,  E/N^  Is  held  constant  at  47  dB. 
In  Figure  33,  JT/N^  Is  held  constant  at  70  dB.  Both  curves  show  that  the 
IDEI  detector  has  a  15-20  dB  advantage  over  the  standard  detector,  depend¬ 
ing  on  the  basis  of  comparison,  for  this  "worst-case"  colored  Interference. 
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Figure  32.  IDEI  and  Standard  Detector  Performance  for 
Interference  of  the  Second  Kind  with  E/N^  =  47  dB 
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Figure  33.  IDEI  and  Standard  Detector  Performance  for 
Interference  of  the  Second  Kind  with  JT/N_  =  70  dB 


3.  ERROR-RATE  SENSITIVITY  OF  IDEI  DETECTOR  TO  IDENTIFICATION  ERROR 

The  next  step  in  the  evaluation  of  the  IDEI  detector  was  to  determine 
the  loss  in  error-rate  performance  when  identification  of  the  required 
colored  interference  statistics  was  less  than  perfect.  It  was  desired  to 
perform  some  sort  of  controlled  sensitivity  study,  varying  only  one  statis¬ 
tical  parameter  at  a  time,  rather  than  immediately  trying  the  ML  identifi¬ 
cation  algorithms. 

It  was  determined  in  Section  III  that  the  necessary  statistical  quan¬ 
tities  to  be  identified  are  the  state  transition  matrix,  4*,  and  Kalman 
(Wiener)  gain  matrix,  G.  Now,  $  is  the  transition  matrix  of  the  interfer¬ 
ence  generating  model.  Given  the  order  of  the  interference  model,  'i'  deter¬ 
mines  the  structure  of  the  colored  interference  process  and  its  equaivalent 
noise  bandwidth,  BW.  Thus,  a  controlled  method  for  varying  ♦*,  the  identi¬ 
fied  matrix,  is  to  obtain  it  from  a  frequency-scaled  version  of  the  "true" 
interference  spectrum  which  produced  $.  In  terms  of  the  S-plane  poles  and 
zeroes  of  the  continuous-time  generator  of  the  colored  process,  frequency¬ 
scaling  simply  means  multiplying  all  poles  and  zeroes  by  the  same  constant, 
K,  where 

BW*  =  K  BW  (164) 

and  BW*  is  the  bandwidth  of  the  identified  process.  This  is  the  method 
used  herein  to  set  up  4>*  for  the  Wiener  filter. 

Given  that  4>*  is  related  to  the  frequency- sea led  interference  spectrum, 
as  above,  the  only  other  unknown  statistic  for  the  colored  interference  is 
its  amplitude  scale.  Let  J  be  defined  as  the  mean-squared  value  (variance) 
of  the  true  colored  interference  process  and  J*  as  the  identified  value  of 
J.  Given  J*,  and  the  true  white  noise  level  (E/N^),  the  identified 
Kalman  gain,  G*,  may  be  easily  calculated  from  the  Kalman  filter  equations. 
This  is  the  method  used  herein  to  set  up  G*  for  the  Wiener  filter.  Symbol¬ 
ically, 

{BW*,  BW}  --  4)* 

{J*,  J.  **,  E/Njj}  ^  G*  (165) 

Note  that  this  controlled  method  for  calculating  ♦*  and  G*  is  not  equiva¬ 
lent  to  the  M-L  method  of  Section  III.  There,  the  computation  algorithm 
have  no  knowledge  of  white-noise  level  (E/N^). 


The  procedure  for  evaluating  the  sensitivity  of  the  error-rate  to 
errors  in  and  G*  is  as  follows.  In  one  case,  BW*  =  BW  and  =  ♦.  The 
closed-form  error-rate  is  then  computed  for  various  specifications  of  J*/J, 
using  the  resulting  G*,  derived  as  above.  In  the  other  case,  J*  =  J.  The 
closed-form  error-rate  is  computed  for  various  specifications  of  BW*/BW, 
using  the  resulting  <t*  and  G*,  derived  as  above. 

Figures  34  and  35  show  the  results  for  a  case  where  the  IDEI  detector 
is  implemented  with  the  true  **  =  4-,  but  G*  is  in  error  according  to  a 
scaling  error  in  the  strength  (variance)  of  the  colored  noise  process 
specified  by  JVJ.  The  error  rates  are  presented  for  SJR  =  -20  dB  and 
BW/BR  =  0.109  which  is  the  narrow-band  interference  of  the  first  kind. 

The  results  are  plotted  versus  E/N^.  These  two  figures  show  that  the  first 
5  dB  of  error  in  colored  interference  strength  cost  only  about  1  dB  in  terms 
of  E/N^  performance.  Beyond  5  dB,  identification  error  is  much  more 
costly  if  the  colored  interference  strength  is  underestimated,  rather  than 
over-estimated. 

Figure  36  shows  a  detailed  examination  of  the  behavior  of  the  various 
elements  which  make  up  the  argument  of  the  error  rate,  P(e).  In  terms  of 
the  expression  for  P{e),  given  in  (11),  v  is  the  mean,  as  calculated  from 
(7)  and  a  is  the  standard  deviation,  as  calculated  from  (8).  The  quantity, 
u,  is  the  actual  tracking  error  variance,  which  is  V  (0),  as  calculated 
from  (9).  It  is  seen  that  neither  u  nor  a  reach  extreme  values  for  perfect 
identification,  when  J*  =  J.  However,  the  ratio,  u/a,  does  maximize  for 
J*  =  J.  Also,  the  interference  tracking  error  variance,  u,  does  minimize 
for  J*  =  J. 

It  is  possible  to  define  a  "Detection  Loss"  factor  as  the  ratio  of  the 
maximum  value  of  u/o  to  its  value  as  obtained  for  any  particular  value  for 
J*/J.  This  factor  is  plotted  in  Figure  37.  Here  the  penalty  for  under¬ 
estimating  the  strength  of  the  colored  noise  process  is  clearly  shown. 

Figures  38  and  39  show  cases  similar  to  those  of  34  and  35  where  now 
the  plot  is  versus  SJR  with  JT/N^  held  constant  at  60  dB.  The  same  conclu¬ 
sions  reached  previously  are  also  supported  by  these  figures.  Figure 40 
gives  the  accompanying  plot  of  detection  loss. 

Figure  41  and  42  are  for  the  same  case  as  34  and  35  where  now  the 
detector  is  implemented  for  J*  =  J  but  (J**  (and  G*)  are  in  error  according 
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Figure  36.  Variation  of  Detection  Statistics  Versus 
RFI  Strength  Identification  Error,  E/N^  =  25  dB 
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Figure  37.  Detection  Loss  Versus  RFI  Strength 
Identification  Error,  E/N^  =  25  dB 
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Figure  40.  Detection  Loss  Versus  RFI  Strength 
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99 


to  a  scaling  error  in  the  bandwidth  of  the  colored  noise  process,  speci¬ 
fied  by  BW*/BW.  The  error  rates  are  again  plotted  versus  E/N^  for  SJR  = 

-20  dB  ana  BW/BR  =  0.109.  These  two  figures  show  that  bandwidth  identifi¬ 
cation  error  is  much  more  costly  if  the  colored  interference  bandwidth 
is  underestimated,  rather  than  overestimated.  Figure  42  shows  that  when 
overestimating  the  bandwidth  the  penalty  becomes,  asymptotically,  just 
that  due  to  the  extra  white  noise  which  is  admitted  to  the  detector. 

Figure  43  shows  the  variation  of  the  error  rate  argument  components, 
as  was  done  in  36.  The  same  behavior  obtains  for  identifying  bandwidth 
as  for  strength. 

Figure  44  shows  a  plot  of  detection  loss  versus  error  in  bandwidth 
identification.  It  is  obvious  that  the  margin  for  error  in  identifying 
bandwidth  is  smaller  than  that  for  identifying  strength. 

Figures  45  and  46  are  for  the  same  case  as  40  and  41  where,  now,  the 
plot  is  versus  SJR  with  JT/N^  held  constant  at  60  dB.  The  same  conclusions 
reached  previously  are  also  supported  by  these  figures.  Figure  47  gives 
the  accompanying  plot  of  detection  loss. 

Figures  34  through  47,  inclusive,  have  presented  an  evaluation  of  the 
sensitivity  of  IDEI  error  rate  to  error  in  identifying  the  strength  and 
bandwidth  of  the  colored  interference  process.  An  initial  conclusion  to 
be  drawn  is  that  the  IDEI  detector  algorithm  is  reasonably  robust  in  terms 
of  identification  error,  so  long  as  the  filter  functions,  4>*  and  G*  are 
synthesized  in  a  deterministic  manner,  based  on  identification  of  strength 
and  bandwidth  of  the  colored  interfering  process.  Such  an  identification- 
synthesis  procedure  is  ad  hoc  and  not  based  on  a  straight-forward  applica¬ 
tion  of  estimation  theory.  Before  proceeding  further  with  it,  it  was  de¬ 
cided  to  evaluate  a  more  rigorous  approach,  that  of  Maximum-Likelihood 
Identification. 
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Figure  43.  Variation  of  Detection  Statistics 
Versus  RFI  Bandwidth  Identification,  E/N^  =  25  dB 
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Figure  44.  Detection  Loss  Versus  RFI  Bandwidth 
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Figure  46.  IDEI  Error  Rate  Versus  SJR  for 
RFI  Bandwidth  Overestimated 
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Figure  47.  Detection  Loss  Versus  RFI 
Bandwidth  Identification  Error,  ^  =  60  dB. 


4.  ERROR-RATE  PERFORMANCE  OF  THE  ML  IDENTIFICATION  ALGORITHMS 

In  Section  III. 3.,  results  were  given  for  the  performance  of  the  ML 
identification  algorithms  in  terms  of  convergence  of  the  estimates  of  the 
parameters  G  and  $  of  the  filter  to  be  identified.  However,  in  the  present 
problem,  the  filter  being  identified  is  embedded  in  a  signal  detector. 

Thus,  a  further  measure  of  identification  performance  is  the  error  rate  of 
the  associated  detector. 

The  6x6  example  of  Section  III. 3.  may  be  used  here.  The  actual  data 
generator  structure  is 

=  1.11439 

Y2  =  -1 .40932  X.|  =  =  Aj  =  1 .0 

Y3  =  0.303111 

=  0.927374 
<^2  =  0.881911 
<^3  =  0.777768 

The  above  structure  results  for  the  following  specification  of  the  signal 
communication  problem: 

Number  of  Samples  per  Symbol  (NSPB)  :  10 

3 

Number  of  Symbols  per  Second  (BR)  :  25  x  10 

Signal  to  Colored  Interference  Ratio  (SJRDB)  :  0  dB 

Colored  Interference  Bandwidth  (BW)  :  2743  Hz. 

Energy  per  Symbol  ?  Noise  Spectral  Density  (E/N^)  ;  Variable 

Table  5  shows  error  rate  results  obtained  using  identified  filter 
structures,  for  values  of  E/N^  between  -15  dB  and  +25  dB  in  5  dB  steps. 

For  each  value  of  E/N^,  identification  was  performed  using  100  data  samples 
and  400  data  samples.  For  both  sets  of  data  samples  the  number  of  iterations 
was  100.  The  filter  gains,  g.| ,  g^.  and  g3  were  initialized  using  proper 
values.  The  transition  parameters,  (j>^ ,  and  were  initialized  at 
0.95,  0.9,  and  0.75,  respectively. 
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TABLE  5 


ERROR  RATE  PERFORMANCE  OF  SJR  =  0 


|E/N^  =  -15  dB 
=  8.88786 
^  =  .174635  X  10’^ 

2  =  -.126974  X  10' 

3  =  .104189  X  10'^ 
p(e)  =  .403394 


E/N^  =  -10  dB 
=  4.99801 
=  .501310  X  10"^ 

2  =  -.374055  X  10' 

3  =  .315661  X  10'^ 
p(e)  =  .339301 


Estimates  <j>* 

Estimates  G* 

Error  Rate 

0 

0 

II 

=  .962275 

1 

9,  =  -.188813  x  10"’ 

* 

=  .909611 

92  =  .129918  x  10'^ 

<>3  =  .749812 

93  =  .155987  X  10"^ 

p(e)  =  .406673 

0 

0 

II 

=  .922637 

9^  =  .525372  x  10"^ 

«2  =  .905056 

92  =  -.694674  x  10‘^ 

41,  =  .749797 

3 

93  =  .122717  X  10"^ 

p(e)  =  .403501 

K  =  100 

<P^  =  .933537 

9^  =  .462744  x  10"’ 

^2  =  .908293 

92  =  -.404340  x  10"’ 

«3  =  .749640 

93  =  .306828  x  10"^ 

p(e)  =  .339498 

K  =  400 

4^  =  .915837 

9^  =  .407356  X  lO"’ 

*2  =  .907796 

92  =  -.298345  x  10"’ 

^3  =  .750128 

93  =  .187085  x  10"’ 

p(e)  =  .339731 

K  =  100 
=  .922487 
<^2  =  .905116 
*3  =  .799720 
K  =  400 


=  .928011 
*2  =  .897036 
'l>3  =  .800237 


=  .119131 

92  =  -.962566  x  10'^ 

gj  =  .876633  x  10"^  p{e)  =  .254793 

=  .120169 

92  =  -.942549  x  10"^ 

93  =  .133610  x  10"^  p(e)  =  .253378 


True  Data 

Estimates 

Estimates  G* 

Error  Rate 

E/N^  =  0  dB 

K  =  100 

r  =  1.58051 

=  .931785 

g^  =  .324643 

=  .303158 

<>2  =  .909121 

02  =  -.284925 

=  -.253838 

(>3  =  .752618 

03  =  .448313  X  10'^ 

p(e)  =  .161505 

g3  =  .246645  x  10‘^ 

K  =  400 

p(e)  =  .159826 

=  .928605 

g^  =  .317638 

<l>2  =  .894738 

02  =  .278292 

«3  =  .754331 

03  =  .414739  X  10”^ 

p(e)  =  .160246 

E/N  =  5  dB 

0 

K  =  100 

r  =  .888785 

=  .932805 

g^  =  .664334 

g^  =  .642817 

<>2  =  .911643 

02  =  -.556296 

g2  =  -.578550 

<t'3  =  .749511 

03  =  .558376  X  10"^ 

p(e)  =  .820992 

03  =  .623676  X  10"^ 

K  =  400 

X  10"^ 

p(e)  =  .800263  x  10"^ 

=  .924907 

=  650377 

<l>2  =  .886843 

02  =  -.569073 

<^3  =  .752203 

03  =  .520069  X  10"^ 

p(e)  =  .803929 

X  10’^ 

E/N^  =  10  dB 

K  =  100 

r  =  .499801 

=  .921746 

g^  =  1.26826 

g^  =  1.27345 

<^2  =  .883289 

02  =  -1.18420 

g^  =  -1.22638 

<(>3  =  .765356 

03  =  .139419 

p(e)  =  .263344 

1 

g3  =  .147568 

K  =  400 

X  10  ' 

p(e)  =  .255149  x  10'^ 

=  .928777 

g^  =  1.25737 

*2  =  .888936 

92  =  -1.19015 

<(>3  =  .769461 

93  =  .136201 

p(e)  =  .257505 

X  10’^ 

Table  5.  (Continued) 


no 


True  Data 


5 


281059 

2.39697 

-2.448 

.3276 

=  .248033  X  10 


;  =  100 

=  .886738  g.|  =  2.27338 

>2  =  .831381  =  -2.42825 

,3  =  .774201  g^  =  .259117 

:  =  400 

=  .938559  g^  =  2.3178 
893108  g^  =  -2.37971 

751622  g^  =  .342483 


E/N  =  20  dB 
0 

=  .158051 
=  4.32571 
,  =  -4.63936 


K  =  100 

=  .94344  g.| 

=  .894073  g^ 

=  .752790  g^ 

K  =  400 


.683923  K  =  400 

=  .116825  X  10"^  (Pj  =  .942188 

<p^  =  .892235  g^ 
<Pj  =  .747709  g^ 


=  25  dB  K  =  100 

.888785  X  10"^  =  .923291  g^ 

7.51162  <^2  =  .875451  92 

-8.38364  <p^  =  .771556  93 


g^  =  7.51162 

92  =  -8.38364 

93  =  1.34467 
p(e)  =  0. 


4.1031 

-4.79684 

.50257 

4.17752 

-4.79354 

.500835 


7.36274 

-8.43728 

1.21118 


K  =  400 

<ti.|  =  .918802  g^ 


=  .918802  g^  =  7.36437 

(>2  =  .870304  92  =  -8.43565 

=  .774477  93  =  1.21267 


Error 

Rate 

p(e)  = 

.346750 

X  10"^ 

p{e)  = 

.261718 

_2 

X  10 

P(e)  = 

.468965 

p{e)  = 

.221338 

p(e)  = 

0 

p(e)  = 

0 

Table  5.  (Continued) 


When  the  filter  gains  are  large,  they  dominate  the  Information  Matrix. 

In  such  cases,  the  tranrition  matrix  values,  ,  ij>2,  (tij  have  lesser  effect. 
The  filter  gains  increase  as  the  ratio  of  colored  noise  to  white  noise 
increases.  Thus  for  a  fixed  ratio  of  signal  to  colored  interference 
(SJRDB  =  0  dB),  the  filter  gains  increase  with  E/N^,  Since  the  error  rate 
decreases  with  E/N^,  it  is  for  low  error  rates  that  good  initialization  of 
the  filter  gain  identification  is  needed. 

When  E/N^  =  20  dB,  estimates  of  and  G  closely  approximate  the  true 
values,  and  yet  the  error  rate  performance  is  poor.  This  is  because  the 
error  rate  is  determined  by  **  and  G*  according  to  the  function  E$*(I  -  G*a), 
as  in  equations  (8)  and  (9).  Thus,  when  |G*1  is  very  large,  the  error  rate 
is  very  sensitive  to  identification  error.  Conversely,  when  |G*|  is  quite 
small,  even  quite  approximate  estimates  give  good  error  rate  performance. 

Another  example  case  was  examined  where  the  generator  structure  was 

=  11.1439 
Y2  =  -14.0932 

Yj  =  3.03111  s  X2  =  Xj  =  1.0 

=  0.927374 

=  0.831911 
413  =  0.777768 

This  structure  resulted  from  the  following  specification  of  the  signal 
communication  problem: 

Number  of  Samples  per  Symbol  (NSPB)  :  10 

3 

Number  of  Symbols  per  Second  (BR)  :  25  x  10 

Signal  to  Colored  Interference  Ratio  (SJRDB)  :  -20  dB 

Colored  Interference  Bandwidth  (BW)  :  2743  Hz. 

Energy  per  symbol  Noise  Spectral  Density  (E/N^)  :  Variable 

Table  6  shows  the  results  for  two  values  of  E/N^,  5  dB  and  30  dB. 

Again,  very  accurate  initialization  of  the  filter  gain  identification 


algorithms  is  required  for  convergence.  In  this  case,  the  ratio  of  colored 
interference  to  white  noise  is  20  dB  greater  than  in  the  previous  example. 
Thus,  the  filter  gains  are  greater  by  roughly  a  factor  of  ten. 


TABLE  6 

ERROR-RATE  PERFORMANCE  FOR  SJR  =  -20  dB 


True  Data 

Estimate  G* 

Error  Rate 

E/Nq  =  5  dB 

K  =  200 

r  =  .888785 

=  .923614 

g^  =  7.41383 

g^  =  7.51253 

<(>2  =  .875887 

g2  =  -8.43760 

p(e)  =  .286132 

=  -8.38495 

413  =  .770917 

g3  =  1.16079 

g^  =  1.34489 

K  =  400 

p(e)  =  .257187 

=  .920892 

g^  =  7.41404 

^2  =  .871545 

g2  =  -8.43599 

p(e)  =  .282038 

=  .772184 

g*  =  1J6233 

E/N^  =  30  dB 

K  =  200 

g^  =  60.8014 

r  =  .499801  x  10’^ 

=  .944248 

g2  =  -74.9986 

g^  =  60.4589 

♦2  =  .894856 

g3  =  15.0013 

p(e)  =  .393391  x  10'^ 

=  -74.7359 

^3  =  .759842 

g3  =  15.1978 

K  =  400 

p(e)  =  0.0 

=  .946587 

g^  =  60.8012 

<^2  =  .895022 

02  =  -74.9988 

<t>3  =  .757249 

03  =  15.0012 

p(e)  =  .953674  x  10‘® 

The  previous  two  examples  show  that  the  identification  algorithms  be¬ 
come  more  difficult  to  initialize  as  the  ratio  of  colored  noise  to  white 
noise  becomes  greater.  However,  these  are  precisely  the  conditions  under 
which  accurate  identification  becomes  less  critical.  It  has  been  shown 
above  that  so  long  as  all  elements  in  G*  are  increased  by  the  same  factor 
the  only  effect  on  the  error  rate  is  that  of  letting  additional  white  noise 
into  the  system.  Quite  large  identification  errors  may  be  tolerated  in  this 
manner. 
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SECTION  V 


RECEIVER  DESIGN  AND  PRACTICAL IH  EVALUATION 
1.  BASIC  RECEIVER  SYSTEM  DESIGN 

Figure  48  shows  the  basic  receiver  block  diagram.  It  includes  the 
two  decision-directed  (0.0.)  filters  for  tracking  both  additive  and  multi¬ 
plicative  colored  interference.  These  two  filters  provide  inputs  (the 
tracking  error  waveforms)  to  the  bit  decision  circuitry.  Also  included  is 
the  identification  circuitry  which  processes  the  received  signal  to  provide 
the  constants  (perhaps  slowly  time-varying)  for  implementing  the  filters. 

The  identification  circuitry  is  also  decision-directed.  For  this  design, 
it  is  assumed  that  timing  and  bit  synchronization  references  are  provided 
externally.  In  the  final  design,  bit  synchronization  will  necessarily 
also  be  derived  directly  from  the  received  signal.  The  method  for  obtain¬ 
ing  bit  synchronization  was  not  considered  in  the  present  investigation. 

The  question  of  feasibility  of  the  present  design  breaks  down  into 
more  or  less  separate  questions  about  the  theoretical  feasibility  and  the 
hardware  feasibility.  A  critical  part  of  the  theoretical  feasibility  ques¬ 
tion  concerns  the  exact  implementation  of  the  identification  circuitry. 

This  is  dealt  with,  separately,  below.  The  hardware  feasibility  question 
concerns  the  implementation  of  both  the  identification  circuitry  and  the 
tracking  filters.  In  particular,  the  hardware  question  is  that  of  how 
to  implement  sampled-data  hardware  at  high  sampling  rates.  This  latter 
question  was  originally  posed  in  [1]. 

Another  part  of  the  theoretical  feasibility  question  is  that  of  deriv¬ 
ing  a  carrier  phase  reference  for  the  tracking  filters.  This  question  is 
not  critical  in  the  context  of  multiplicative  noise  (multipath).  In  [3] 
it  was  shown  that  a  multiplicative  noise  tracking  receiver  also  tracks  out 
the  phase  error  of  a  carrier  phase-locked  loop  subjected  to  the  multiplica¬ 
tive  noise  environment.  It  is  therefore  conjectured  that  a  receiver  with 
tracking  capability  for  both  multiplicative  and  additive  colored  noise  will 
track  out  the  phase  error  of  a  carrier  phase-locked  loop  subjected  to  the 
additive  noise  environment.  However,  the  question  may  be  critical  for  an 
interfering  c.w.  carrier  which  is  close  enough  in  frequency  to  the  trans¬ 
mitted  carrier  to  capture  the  phase-locked  loop.  The  question  of  the  effects 
of  additive  interference,  c.w.  or  noise-like,  on  the  carrier  tracking  loop 
should  be  investigated  for  the  lOEI  detector. 
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Figure  48.  Basic  Receiver  Block  Diagram 
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2.  IMPLEMtNTATION  OF  IDENTIFICATION 

From  [1],  the  optimum  set  of  required  identifying  algorithms  are  those 
which  yield  minimum  mean-squared-error  between  the  true  and  identified 
structure  of  the  colored  interference  generator.  Also,  because  the  IDEI 
tracking  algorithms  are  sampled-data  recursive,  memory  requirements  can  be 
minimized  if  the  identification  algorithms  are  also  sampled-data  recursive. 

The  algorithms  actually  developed  during  the  present  investigation 
were  based  on  the  Maximum  Likelihood  estimation  criterion,  rather  than  the 
Conditional -Mean  criterion,  called  for  in  [1].  These  M.L.  algorithms  do 
not  necessarily  yield  minimum-mean-squared-error  for  estimation  of  the 
structure  parameters.  Neither  are  they  completely  recursive,  since  they 
operate  on  batches  of  received  data  vector  measurements.  The  reason  that 
batch-M.L.  identification  was  used  is  that  there  existed  previous  well 
documented  theoretical  work  in  the  general  area.  The  previous  work  was 
extended  to  the  specific  case  of  a  coupled  I-Q  data  vector,  using  the 
Minimum  Canonical  Form  for  the  interference  generator  which  was  originally 
derived  under  this  investigation. 

The  results  of  Sections  III. 3  and  IV. 4  showed  several  interesting 
facts.  First,  when  the  colored  interference  vector,  ii(k),  was  modeled  as 
Markov-1  (the  ❖-  matrix  is  2x2)  the  M-L  identification  algorithm  converged 
nicely  to  and  6*  with  reasonable  initialization  of  the  estimates.  How¬ 
ever,  when  jr(k)  was  modeled  as  Markov-3  (the  ^-matrix  is  6x6)  extremely 
accurate  initialization  was  required  for  convergence.  Secondly,  it  is 
possible,  even  with  good  convergence,  for  the  resulting  error  rate  to  be 
poor,  as  for  E/N^  =  20  dB  in  Table  5  on  page  106.  Thus  it  appears  that 
the  IDEI  tracking  detection  performance  can  have  great  sensitivity  to  the 
structure  of  the  filter  as  identified  by  the  M.L.  algorithms,  even  when  the 
convergence  is  quite  good. 

The  possible  poor  error  rate  under  ML  identification  should  be  con¬ 
trasted  with  the  good  error  rate  sensitivity  demonstrated  in  Section  IV. 3 
where  the  identified  filter  structure  was  far  removed  from  the  optimum 
structure.  In  terms  of  identification  error  the  filter  structure  was  poor 
and  yet  the  error  rate  remained  good.  What  these  results  imply  is  that 
there  probably  exists  an  ad  hoc  identification  scheme  which  will  perform 
much  better  that  the  "optimum"  M-L  identification  algorithm,  so  far  as 
minimizing  probability  of  error  is  concerned. 
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One  such  ad  hoc  scheme  would  be  to  model  the  possibly  Markov-N  dis¬ 
turbance,  y{k),  as  Markov-1  and  use  the  simple  2x2  identification  algorithm 
to  identify  a  "dominant  pole"  in  the  ^-matrix  and  a  dominant  gain  term  in 
the  G-matrix.  The  actual  Nth-order  it*  and  G*  could  then  be  synthesized 
using  a  deterministic  filter  model  such  as  Butterworth  or  Chebyshev. 

Another  ad  hoc  scheme  would  be  to  estimate  directly  the  amplitude  and 
bandwidth  of  the  disturbance,  y.(k),  and  deterministically  synthesize  a 
filter  for  the  identified  amplitude  and  bandwidth  process  using  a  "design- 
point"  value  for  E/N^. 

It  is  clear  that  further  refinement  of  the  method  of  implementing 
identification  is  required  before  the  IDEI  detector  can  be  stated  to  be 
theoretically  feasible  for  non-band-limited  signals  such  as  PSK  and  FSK. 

Such  further  work  should  concentrate  on  a  combination  of  sub-optimal  iden¬ 
tification  of  fewer  parameters,  coupled  with  deterministic  filter  synthesis. 

3.  HARDWARE  PRACTICALITY 

The  key  question  about  hardware  remains  that  of  fast  sampled-data 
processing.  The  tracking  filters  need  not  be  overly  complex,  having,  per¬ 
haps,  from  one  to  three  states  per  In-phase  and  per  Quadrature  vector  ele¬ 
ment  per  multiplicative  noise  tracker  and  per  additive  noise  tracker. 
However,  the  tracking  filters  must  process  samples  at  a  much  higher  rate 
than  the  Nyquist  rate,  at  least  for  non-band-limited  PSK  and  FSK  signals. 
Also,  the  identification  processor  must  accept  samples  at  the  same  rate 
during  the  interval  of  time  over  which  it  is  collecting  data.  It  does  not, 
necessarily,  need  to  process  the  data  at  the  same  rate  as  the  recursive 
tracking  filters.  Thus,  the  practicality  of  hardware  is  mainly  to  be  det¬ 
ermined  by  the  implementation  of  the  fast  tracking  filters.  The  required 
processing  speed  is  proportional  to  the  bandwidth  of  the  disturbance  being 
tracked.  For  narrow-band  disturbances  and  symbol  rates  less  than,  say, 

2400  BPS,  the  processing  speed  may  be  achieved  using  standard  digital  hard¬ 
ware.  For  wide-band  disturbances  and  high  data  rates,  CCD  filters  may  be 
applicable.  A  practical  hardware  design  will  be  completely  dependent  on 
the  signalling  environment  and  interference  scenario. 
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SECTION  VI 


CONCLUSION 

This  report  has  documented  the  results  of  a  fourteen  month  effort  to 
determine  performance  boundaries  for  Integrated  Detection,  Estimation, 
and  Identification.  The  best  performance  of  the  IDEI  detector  for  perfect 
identification  has  been  determined  using  PSK  and  FSK  signal  modulation  and 
the  probability  of  error  performance  criterion. 

It  was  shown  that  the  IDEI  algorithms  with  perfect  identification  nro- 
vide  performance  which  is  orders  of  magnitude  better  than  that  of  standard 
detectors  optimized  for  white  noise  only,  when  the  additive  and/or  multi¬ 
plicative  interference  is  colored.  Furthermore,  it  was  shown  that  the 
optimum  performance  degrades  smoothly  with  increasing  error  in  identifi¬ 
cation  of  the  strength  and/or  bandwidth  of  the  additive  colored  process. 

A  most  interesting  result  was  that  the  error-rate  performance  of  the 
IDEI  detector  depends  not  only  on  the  accuracy  of  identification  but  also 
on  the  exact  mechanism  of  the  identification  error.  This  result  was  dwelt 
upon  in  Section  V.  This  result  implies  that  rigorously  derived  stochastic 
identification  algorithm  may  not  be  the  best  solution  for  the  IDEI  detector. 

Another  interesting  result  is  the  apparent  better  performance  of  PSK 
over  FSK  in  heavy  additive  colored  interference.  This  was  shown  in  Figure 
13,  14,  15,  and  19.  Since  both  closed  form  and  Monte  Carlo  results  agreed, 
the  result  is  presumed  to  be  valid.  The  physical  explanation  for  this  re¬ 
sult  has  not  been  found  during  the  present  work. 

Based  on  the  results  obtained  in  this  investigation,  the  next  steps 
required  for  reducing  the  detector  to  practice  become  clear.  First,  a 
better  method  for  identifying  the  structure  of  the  tracking  filter  is  need¬ 
ed.  It  is  recommended  that  a  procedure  be  used  which  is  partly  stochastic 
and  partly  deterministic.  The  stochastic  identification  would  be  confined 
to  just  the  strength  and  bandwidth  of  the  interfering  colored  process.  The 
tracking  filter  would  then  be  deterministically  synthesized  to  match  the 
identified  process. 

Second,  the  IDEI  detector  must  be  augmented  with  a  carrier  phase  esti¬ 
mator  for  obtaining  the  required  carrier  phase  references.  The  effects  of 
the  multiplicative  and/or  additive  colored  processes  upon  the  carrier  phase 
estimate  and  also  upon  the  detector  error  rate  must  be  determined 
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quantitatively.  Alternately,  it  should  be  determined  whether  or  not  the 
I DEI  technique  can  be  applied  to  incoherent  detection  wherein  the  carrier 
phase  dependency  is  deliberately  averaged  out  of  the  detection  algorithm. 
An  intermediate  step  between  the  coherent  and  incoherent  IDEI  approaches 
would  be  to  determine  if  the  coherent  IDEI  detector  can  be  augmented  to 
obtain  carrier  phase  from  symbol  to  symbol,  as  in  DPSK. 

Finally,  the  method  for  maintaining  bit  synchronization  and  system 
timing  must  be  determined,  implemented,  and  evaluated.  It  is  felt  that 
this  scheme  will  probably  be  an  "early-late"  implementation  which  is  more 
or  less  standard. 

To  summarize,  it  is  felt  that  the  IDEI  detector  has  been  shown  to 
possess  sufficient  performance  properties  to  warrent  further  analysis, 
design,  and  ultimate  development.  It  is  hoped  that  the  effort  to  develop 
the  IDEI  detector  will  be  continued  to  fruition. 


APPENDIX  A 

DERIVATION  OF  THE  PSEUDO-INNOVATIONS 
AUTOCOVARIANCE  FUNCTION 

In  Section  II,  the  autocovariance  function,  V^^{j)  for  j  =  0,  1,  2, 
...,  was  required  to  numerically  evaluate  the  closed  form  expression  for 
error  rate  of  the  IDEI  detector  under  mis-identification.  The  autocovari¬ 
ance  function  is  the  covariance,  E{^(k)£'^(k-j)},  where  |_(k)  is  the 

pseudo-innovations  process  of  a  Kalman  filter  whose  structure  is  not  opti¬ 
mum  for  the  signal  being  filtered.  Figure  1,  below,  shows  the  structure 
of  the  actual  generating  model  for  the  signal  process,  y(k),  and  the  Kalman 
filter  using  identified  structure. 

The  equations  governing  the  actual  data  generator  are 

x(k+l)  =  $x(k)  +  rw(k);  =  I 

x(k)  -  Ax(k)i  V„„(k)  . 

i(k)  =  y.(k)  +  n(k)  =  Ax{k)  +  n(k)  A-1 

The  Kalman  filter  equations  are 

i(k|k)  =  x(k|k-l)  +  G*i{k) 
x{klk-l)  =  x{k-llk-l) 

^(k)  =  i(k)  -  Ax{k|k-1)  A-2 

In  the  data  generator,  the  input  driving  process  may  be  assumed  to  be 
white,  Gaussian,  zero-mean,  with  unit  variance.  Also,  the  output  matrix, 

A,  may  be  assumed  known  and  fixed.  Any  particular  autocovariance  for  jr(k) 
may  be  realized  through  manipulation  of  only  r,  $,  and  N,  the  order  of  the 
filter-generator.  The  additive  white  (receiver-generated)  noise,  n(k),  is 
modeled  as  having  a  variance,  V^^,  which  is  not  known,  a  Priori. 

Since  A  is  known,  the  only  elements  of  the  Kalman  filter  which  need 
be  identified  are  the  gain,  G*,  and  transition  matrix,  4>*,  which,  latter, 
is  the  counterpart  of  the  ♦-matrix  in  the  generator.  If  G*  is  identified 
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directly  from  the  data,  |.(k),  then  the  white  noise  variance,  V  ,  need  not 
be  identified  separately. 

The  state-prediction  error  is  defined  as 

^(k|k-l)  =  )<(k)  -  x.(k|k-l)  ^"3 

The  pseudo-innovations  may  be  written  in  terms  of  the  prediction  error, 
^{k]k-l)  as 

^(k)  =  A^(klk-l)  +  ]i(k) 

In  the  steady-state,  y(k)  and  n(k)  are  zero-mean  and  so  is  £(k). 

Thus,  the  steady-state  auto-covariance  function  for  ^(k)  is  given  as 

V^^(j)  =  E{c(k)J(k-j)} 

=  AE{x(k|k-l)x^(k-j|k-j-l)A^ 

+  AE{x(k|k-l)n''’(k-j)};  0<j  A-5 

where  use  has  been  made  of  the  facts  that  since  n(k)  is  white  and  indepen¬ 
dent  of  w(k),  then 

n(k)  1  x(k-j|k-j-l)  ;  0  <  j 

n(k)  in(k-j)  ;  0  <  j 

To  evaluate  the  expectations  in  A-5  requires,  first,  the  one-stage 
evolution  equation  for  2L(klk-l),  which  is  obtained  as  follows. 

x(klk-l)  =  $*x(k-l|k-l) 

=  $*[x(k-llk-2)  +  G*i(k-1)] 

=  «.*x(k-l|k-2)  +  $*6*[z(k-l)  -  Ax(k-llk-2)] 

=$*[!-  G*A]x(k-l|k-2)  +  **G*[Ax(k-l)  +  n(k-l)] 

=  $*[I  .  G*A]x(k-l|k-2)  +  ♦*G*  x(k-l) 

+  ♦*G*n(k-l)  A- 7 
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Next,  the  one-stage  evolution  equation  for  x(k|k-l)  is  obtained  as 

x(k|k-l)  =  x(k)  -  x(k|k-l) 

=  $x{k-l)  +  rw{k-l)  -  ♦*[!  -  G*A]x(k-l|k-2) 

-  $*G*A)((k-l)  -  it*G*n(k-l) 

=  $*[I  -  G*A][x(k-l)  -  x(k-11k-2)] 

-  $*[1  -  G*A]x(k-l)  +  [♦*  +  A4']^(k-1) 

+  rw(k-l)  -  4>*G*Ax(k-l)  -  $*G*n(k-1) 

=  $*[I  -  G*A]x{k-l|k-2)  +  A*x(k-1)  -  ♦*G*n{k-l) 

+  rw(k-l ) 

where  $*  =  $  -  a$ 

The  j-stage  evolution  equation  follows  as 

i  .  k-1 

x(klk-l)  =  [$*(I  -  G*a]'‘’  x(k-jlk-j-l)  +  I  [$*(I  + 

i=k-j 

-  G*A)]’^"^"’[A4ix{i)  -  »*G*n{i)  +  rw(i)]  a. 9 

It  follows  that 

E{x(k|k-l)x^(k-j|k-j-l)}  =  [$*(I  -  G*a]^  E{x(k-j|k-j-l)  • 

lk-j-1 )}  +  I  ['*'*(1  -  G*a)]*^  • 

i=k-j 

E{[A<)ix(i)  -  **G*ji(i)  +  rw{i)]x^(k-jlk-j-l)} 

=  [$*(I  -  G*a)]'^  E{x(k-j|k-j-l)x^(k-j|k-j-l)} 

+  I  [4,*(I  _  G*A)]''"^"^A4'E{4i)x^(k-j|k-j-l)} 
i=k-j  A-10 
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wherein  use  has  been  madp  of  the  fact  that 

x(k-j|k-j-l)  1  w(i)  ;  i=k-j,k-j-l . k-1 

x(k-j|k-j-l)  1  n(i)  ;  A-11 

Now,  i-1  . 

x(i)  =  <f’‘^'^'^^x(k-j)  +  I  <t’"^'^rw(^)  A-12 

<'=k-j 

and  thus 

Elx(i)x^(k-j|k-j-l)) 

_  <{,i"('^"j^E{x(k-j)x^(k-jlk-j-l)}  +  I  ^  ^  • 

£=k-j 

rE{w(£)x'^(k-jlk-a-l)} 

=  4i’"^''“'^^E{x(k-j)x^  (k-j|k-j-l)}; 

x(k-jlk-j-l)  1  wU)  :  A-13 

Substituting  A-13  into  A-10  gives 

E{x(k|k-l)x^(k-jlk-j-1)}  =  [$*(I  -  G*a)]'^  E{x(k-j  jk-j-l )  • 

x^(k-j  I k-j-1 )}  +  I  [♦*(!  -  G*a)]*^  ^  •  Alt  • 

i-k-j 

.  E{x{k-j)x^(k-j|k-j-l)}  A-14 

Now,  the  cross-variance  term  between  x(k-j)  and  x(k-jlk-j-l)  must  be 
computed. 

E{x(k)x^(kl k-1 )} 

=  E{x(k)[<P*(I  -  G*A)x(k-l|k-2)  +  A*x(k-1)  -  $*G*n(k-l) 

+  rw(k-l)]^} 

=  Ef[<l>x(k-1)  +  rw(k-l)]['f*(I  -  G*A)x(k-l  lk-2)  + 

+  A4'x(k-1)  +  rw(k-l)]^} 

(continued) 
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=  ♦E{x{k-l)x^{k-l|k-2)}(I  -  G*A)V^  +  $E{x(k-l)  • 

)J(k-l)}A4>^  +  rr^  A-15 

where  use  has  been  made  of  the  facts  that 

x{k)  in(k-l) 
x(k-l)  1  w(k-l) 

x(k-l|k-2)  1  w(k-l)  A-16 

Similarly, 

E{x(k|k-l)J(k) 

=  <t*(I  -  G*A)  E{x(k-l|k-2)/(k-l))*^ 

+  A*E{x(k-l)J(k-l)}J  +  rr^  A-17 

Equations  A-15  and  A-17  are  recursive.  Now  define 

E{x(k)x^(k|k-1)}  -  Vj^j(k)  ;  with  steady-state  solution, 
E{x(k| k-1 )x^{k)}  -  ;  with  steady-state  solution, 

E{x(k)x^(k)}  =  steady-state  solution, 

A-18 

Then,  it  follows  that 

Vxx(k)  =  «Vj^^(k-l)J  +  rr^ 

Vxj(k)  =  <i-V^j(k-l)  ♦  (I  -  G*A)V^  +  4>Vj^^(k-l)AJ  +  rr^ 
(k)  =  4>*(I  -  G*A)V‘Vr^{k-l)J  +  A*V^^(k-l)4>^  +  PF^ 

XX  XX  XX 

A-19 
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Next,  define 

E{x(k|k-l)x^(k|k-1)}  =  V^jo(k!k-l) 
E{x(klk-1)x^(k-j|k-j-l)}  =  Mk,  k-j|k-l,  k-j-1) 


A-20 


Then  becomes 


V5^(k,  k-j|k-l.  k-j-1)  =  [t*(I  -  G*A)]Jvjj(k-j|k-j-l)  + 
k-1 

+  I  [♦*(!  -  G*A)]*^"^"’  •  A4>  •  -'-(k-j) 

i=k-j 


where  Vj^^(k-j)  is  the  steady-state  value  defined  by  the  recursion  of  A-19 
and  V^(k-j  I  k-j-1 )  is  the  steady-state  defined  by  the  following  recursion 


V;^{k|k-1)  =  E{y(k|k-l)x^{klk-l)} 

=  E{[$*{I  -  G*A)x(k-l|k-2)  +  A*x(k-1)  -  ♦*G*n{k-l) 

+  rw(k-l)]  •  C-]^} 

=  <t*(i  -  G*A)E{x{k-l|k-2)x^{k-llk-2)l  •  (I  -  6*A)V^ 

+  ♦*(!  -  G*A)E{x(k-l  jk-2)J(k-l)AJ 
+  A0E{x(k-l)x^{k-l|k-2)}  •  (I  -  G*a)V^  +  A*E{x(k-l)  • 
J(k-1)}A4.^  +  (t*G*V^^G*V^  +  rr^  A-22 


which  reduces  to 

Vjj(k|k-1)  -  ♦*(!  -  G*A)V^(k-l|k-2)(I  -  G*A)V^ 

+  A<>Vjjj^(k-l  )A't'^  +  $*(I  -  G*A)V^^(k-l)A4>^ 

+  A4>V^^(k-l  )(I  -  G*a)^4'*^  +  4>*G*V^^G*^$*^  +  rr^ 

There  remains  to  be  evaluated  the  term 
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E{x(k|k-l)n^(k-j)}  =  [♦*(!  -  G*A)]'^  E{x(k-j|k-j-l)n''^(k-j)} 
k-1  k-l-i 

+  ^  [$*(I  .  g*a)]  E  {[A4>x(i)  -  <>*G*n{i) 

i=k-j 

+  rw(i)]n^(k-j)} 

j-1 

=  -  [$*(I  -  G*A)]  **G*V^n  ;  0  <  j  A-24 

The  computational  steps  are  now  enumerated  as 

i)  k-j|k-l,  k-j-l)A^ 

j-1 

-  A[$*(I  -  G*A)]  $*G*V  „ 

nn 

ii)  k-j|k-l,  k-j-1)  =  [♦♦(I  -  G*A)]'^V5^(k-j|k-j-1) 

+  I  [4i*(I  -  G*a)]'^"^"’  •  A*  ♦  .  ''xx^'^"'’^ 

i=k-j 

iii)  V;^(k|k-1)  =  $*(I  -  G*A)V^(k-l  |k-2)(I  -  G*a)^$*^  + 

+  A4>V  (k-l)A*^  +  4>*(I  -  G*a)V5.  (k-l)A4'^  + 

+  A$V^;^{k-l)(I  -  G*a)^$*^  +  $*G*V^^G*^$*^  +  rr^ 

iv)  V^%(k)  =  .  (I  -  G*a)^4.*^  +  4>V^j^{k-l)A4)^  +  r/ 

v)  ^  "  ^*A)V5^j^(k-l)*^  +  A$V^^(k-l)$^  +  rr^ 

vii)  V^^(j)  =  AV5^(k|k-l)A^  +  ;  j=0  ;^_25 

Now,  let  and  be  the  steady-state  solutions  of  A-25. 

Then  the  auto-covariance  function  of  the  pseudo-innovations  is 
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APPENDIX  B 


STRUCTURE  OF  THE  PSEUDO- INNOVATIONS  AUTOCOVARIAMCE 
FUNCTION  FOR -fl.  GENERAL  IN-PHASE/QUADRATURE  PROCESS 


Statement  of  the  Results 

The  covariance  of  the  2-vector  stationary  Pseudo-Innovations  Process, 
C(k),  is 

v^^(j)  =  A[#*(I  -  -  G*(aV^A^  +  V„„)] 


XX 


XX 


nn' 


+  A{  5;  [4>*(I  -  G*a)]’“’a$  *'^‘^}V„'vA^ 
i=l 


for  0  <  j 
where 


=  $*(1  -  G*a)V^(I  -  G*A)V^ 

+  A$V  •^(I  -  G*a)^$*^  +  4>*{I  -  G*a)V''' 

A  A  X  A 

+  A4)V^^A$^  +  r  +  $*6*V^^G*^(i>*^ 

'^xx  ~  ^'^xx^^  "  *^*^)**^  '*■  +  r 


V-v-  =  V  % 

XX  XX 

V  =  $V  +  r  r"^ 

XX  XX 


It  will  be  shown  that 


(I  -  G*A)  = 


'  ^II  ^IQ 
^QI  ^QQ 


'  S  S' 
j-S'  sj 


♦♦(I  -  g*a)  = 


$  $ ' 

l-o'  9 
r 


j  S  S'  r $S-*’S'  ,  «S'+*'S"" 

[-S'  sJ  jj-^’S-tS'  ,  -o'S'+$sj 


A  ,  A 


F 


I 


-f'  f 


(a) 
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From  (a)  and  Lemma  1,  it  will  be  shown  by  induction  that 


V''j'v  = 

XX 


V'Ia."' 

XX 

XX  1 

V'X.  = 

V-vv. 

XX 

XX 

XX  J 

XX  XX  I 

-V't  V-x. 

XX  XX 


V  V 

XX  XX 

-V  V 

.  XX  XX 


It  will  finally  be  shown  that 


XX  1  , 


L3 


+  V  )  4  ^ 

"  "  -a; 


whence 


-  SMaVjja''  »  V„„)  = 


i  1 

-e*  e 


It  is  also  easily  seen  that  if  the  In-phase  and  Quadrature  processes  are 

independent  (uncorrelated),  then  the  off  diagonal  terms  are  null  for 

4>*{I  -  G*a),  $*,  V^,  V  G*,  and  [V^a^  -  G*(AV'yvA^  +  V„).  Thus, 
XX  XX  XX  XX  nn 


for  the  uncorrelated  case 


:  o^^(0)scalar 


For  the  correlated  I-Q  case,  in  general. 


“vj  (j)  vj’  (j)' 

V.Jj)  = 


Supporting  Lemmas  and  Theorems 
Lemma  1 

A  and  B  are  (nxm),  (mx^)  partitioned  matrix  respectively. 


A  = 

2  -  P' 

-A^ 

l-B,  B,_ 

Then  the 

resultant  matrix  C  =  AB 

is  also 

'c  c1 
c  =  I  N 

L'S  hj 

proof 

f* 

A]  ^2 

AB  =  ‘  ' 

h\  !  ^i®r^2®2’ 

1  “  j 

:"2  *  L'®2 

B^l  M2Bi-AtB2, 

L-^2 


Lemma  2 


Ce,,  j-. 

-b'  b  Gol 


[e^b-e^b',  e^b’+egb]  p-i  j 


=  e^be^  -  ^  ®2*’®2  “  *  ^2^^ 

=  b[e^,  e^l  pe-f. 


Lemma  3 


:'1^' 


[e, ,  e,]  b  -b'  ,  b  bH  ■  e. 


L^’ 


f.  q 

l-u;  U  I  l-b'  b 

1  C  Cj  L 


L®2, 


[e,,  e,]  fbu +b'u;  .  bu'-bq; 

l^b'.^-bu',  b-u;+bu^j 


I  b  b’ 

I 

;-b'  b 


J2 


C^1 » 


[e-i  ]  e»_] 


bu  b+b'u‘b-b.j‘b'+b'u  b' ,  bo  b'+h'o‘b'+bo'b-b'u  b 
b'u  b-bu'b-b'.j  b‘-bu  b',  b‘u  b' -bo' b'+b' o‘ b+bo  b 

c  c  c  t,  c  f.  e 


(b2+b-2)u^  ,  (b2+b'2)o' 

-(b2+b‘2)u^  .  (b2+b'2)o^ 


re1 

[■ 


e 


(b2  +  b'2)o^[e^,  62] 


Behavior  of  Kalman  filter 


*1  0  ; 

H 

0 

'Xj(l;} 

0  '*‘N  ! 

0 

' 

' 

XQ(k) 

’-*1  '0  1 

0 

.  0  ; 

0 

\ 

Xj{k-1) 


-Y 


1 


"1  ^1 
^2 


M 


;wi(k-i  ■] 

iw2(k-l)- 


B-1 


'z,(k)|  ^ 

'1 

0  0" 

r^iik)- 

rn,(k) 

+  1  1 

_Zp(k)[ 

0 

0  x,^^ 

l^Xg(k) 

i 

B-2 


Xij(k)  =  <|>^Xjj(k-l)  +  4'jXgj(k-l)  +  >jW^(k-l)  +  YjW2(k-l)  B-3 
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XQj(k)  =  Xjj(k>1)  +  4’jXqj(k-l)  -  Yj  w^(k-l)  +  YjW2(k-l) 

B-4 

j  =  1,  2,  ...  N 

where  2  x  N  is  the  order  of  the  system 

1.  X(k|k-1)  =  $X(k-l|k-l)  B-5 

Xij(k|k-1)  =  4,j.Xjj(k-lIk-1)  +  <^jXqj(k-l|k-l)  B-6. 

XQj(klk-l)  =  -  .fr'Xjjdc-llk-l)  +  <^ipj(k-11k-l)  B-7 

2.  V^{k|k-1)  =  4>V^(k-l  |k-l  +  rr^  B-8 

Define 

Vii(.)  =  E{Xj{.)  xj(.)} 

Viq(-)  =  E{Xj(.)  Xj(.)} 

Vqi(-)  =  E{y.)  x[(.)} 

Xj{klk-1)  =  Xj(k)  .  Xj(k|k-1)  g_g 

'V/ 

Xq(k|k-1)  =  Xq(k)  -  x^(k|k-l)  B-lo 

More  detailed  expression  is  given 

-v,  -V 

Xij(klk-l)  =  ())jXjj(k-l  I k-1 )  +  <|) jXqj(k-l  I k-1 )  +  YjWi(k-l)  +  yj-w^Ck-l) 

B-11 

Xqj{k|k-1)  =  -<jijXjj(k-l  I k-1 )  +  <|>jXqj(k-1 1 k-1 )  -  YjWi(k-l)  +  YjW2(k-1) 


V„(k|k-1)  V,n{k|k-1) 

Vlj(klk-l)  =  ”  , 

V,,(k|k-1)  v..(klk-l)| 


[v’’'^(v)]  denotes  the  ith  row  jth  column  of  V(-)  matrix 


V„{k|k-1)  =  E 


'’x.,(k(k-l) 


“  X,,(klk-1) 


f  Xj^(k|k-1)  I 

I  _j 


[X|^(k|k-l) . X,j(klk-1),  ; 

X,„(k|k-))]J 


therefore 


[vj|j(k|k-l)]  =  E{U.Xj.{k-llk-l)  +  ,„!XQ.(k-l|k-l)  +  y.w,(k-l)  + 

+  +  4.jXpj(k-llk-l)  +  Y.w^(k-I)  +  VjW2(k-1)] 

=  ^,.^.E{Xj.(k-llk-l)Xjj(k-llk-l)}  +  (j>.(|.jE{Xj.(k-llk-l)Xpj(k-l|k-1)} 

'\j  "u  'X,  “V 

+  4i'<^jE{Xg.(k-llk-l)Xjj(k-llk-l)}  +  <l>;'^jE{XQ.(k-llk-1)XQj(k-llk-1)> 

+  y  .y .  +  Y Y 
1  J  1  J 

=  '^.■^j[v;|^(k-llk-l)]  +  <C/jCvi^j(k-llk-l)] 

+  t:^j[vjj’j(k-ilk-i)]  +  t:<fi[vjj'^(k-ilk-i)]  +  +  vjYj 


Similarly 


[vi^J{k|k-l)]  =  E{U.Xj.(k-l|k-l)  +  4,^Xp.(k-llk-l)  +  Y/i(k-l)  + 

+  Y-W2(k-l)][-<^jXjj(k-l|k-l)  +  ,|>jXQj(k.llk-l)  -  Y^w^(k-l)  +  Tf.W2(k-l)3 

=  -^i^^cvj|'’(k-i|k-i)]  +  ^i^^[v;j^(k-itk-i)]  -^:*jCvjj^(k-i|k-i)3  + 

+  ^;<^ji:vj’j{k-iik-i)]  -  Y^Yj  +  Y^Yj  b-16 

[vjj^^k|k-i)]  =  E{[-.fr;.Xj.(k-i|k-i)  +  ^.Xp.(k.i|k-1)  -  Y:w^(k-1)  + 

+  YiW2(k-l)][^.Xj.(k-llk-l)  +  <^lXQj(k-l|k-l)  +  YjWT(k-l)  +  YjW2(k-l)] 
=  -4.:^,.[vj|^(k-llk.l]  -  <^t*J[vj^^(k-l|k-l)]  +  ♦.i.j[vjj^(k-llk-l)]  + 

+  ^i'^jtvJq'^Ck-ltk-l)]  -  Y^Yj  +  Y^Yj  B-17 


[vj’j(klk-i)]  =  E{[-^;.Xj.{k-i)k-i)  +  ^.XQ.(k-ilk-i)  -  Y:wT(k-i)  + 

+  YiW2(k-^)][-<^jX^.(k-^lk-l)  +  ^jXpj.{k-1|k-l)  -  Yjw^(l<-1)  + 

=  ^I^^[v;|^(k-Ilk-1)]  -  ^;^j[vi^^(k-i!k-i)]  -  ^,.^J[vJj'Mk-ilk-Dl  ^ 

+  <t.^j[vj*j(k-l|k-l)]  +  YlYj  +  Y^Yj  B-IS 

G(k)  =  Vy^Cklk-DA"^  [V  +  AVWklk-DA'^]"'' 


UV';  'xx  '  nn  XX'  '  '  ^ 

I  X  ^  0 

vwk|k-i)A'^=  rv„(kik-i)  vjQ(kik-ir|  \x^^  0 


VQi(Mk-l)  VQQ(klk-l)J  0  X,  I 


^NJ 


r  I  vi;''{k|k-i)x,  .  .1  vjjJ(kik-i)Xj 

j  j=l  ^  3=1 

!  “  v'ij(k|k-i)A  .  Iv;5i(k|k.i)»j 
:  j=i  ^  3=1 


i  »  1,  2.  ...  N 


AV^(kik-l  )A 


X,  X.,  0  0 

l  N 

*1  0  X-j  X|^ 


I  v!;J(k|k-i)x  ,  I  v;’^(k|k-i)x, 
j=l  “  “^0=1^ 


J  v"-j(k|k-l)A„  I  V^jUklk-DA/ 
j=1  "  j=l  ^ 

I 

I  j^vJ;J(k|k-i)Aj.  J^vj^^(k|k-i)Aj 


J^v3iJ(kik-i)Xj,  J^v|;ji(kik.i)Xjj 

r  N  N  .  .  N  N  .  .  -1 

U'<  ■  J," 
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Equation  b_20  car>  t*®  rewritten  as 


B(k)  =  AV^(klk-l)A' 


"n  N  .  .  N  N 

=  I  I  A.A  V  ’J(k|k-1)  .  I  I  A.A.V;*J(klk-l) 
i=1j=1  ^  ^  “  i=1  j=l  ^  ^ 


N  N 


■  y,  I  A.x.v:|-^(kik-i) ,  I  I  A.A^vi-j(kik-i) 

^i=1j=l  1  -1  i  =  l  j=i  1  J  W 


1 


"  ^ir  ^iQ 


Q-hi,)  - _ 1 

-  ditlBl'i.j, 

L  °QI  % 

where  det(B)  =  bjjbqq  -  b^^b^j 


Combining  equations  B-19  and  B-22,  it  is  easily  obtained 


G(K)  =  V5^(klk-1)A'^B‘''(K) 


_ 1  -II  -IQ 

det(B)  G  G  ” 

^Qj 

N  ..  .. 


r  N  .  .  N  .  .  N  N 

'  I  V  :J(klk-i)x  ,  lV  5J(klk-i)x  I  I  X  X  V  :J(klk-i). 

j  =  l  AX  ,  J  xy  J  1  J  XI 

f 

i  N  '  N  f,  .  -I  yx.XiVj:j(k)k.i). 


1  |.V‘ii^<Mk-i)Aj  ,  L’  I' 

7rT;J‘'  J"'  -bni 


det{B)  i 


1  J  *  '  J  “*  I  , 


i  N  I  ^ 


•J  Ix,»jV|5X(klk.l) 

X  3  1 


"QQ 

B-23 


‘WK' 


N  .  . 


S„  =  ( y  v|jj(k|k-i)jj)b„  -  ( I  v;jJ(k|k-i)Xj: 

.1  =  1  J"' 


{  y5'jj(k|l<-1)A.)bjj  -  {_I^V;^'’{k|k-l)A.)b, 


N  w  1 


N  .•  .• 


^  i  i 

V  w' 


%  ■  ♦  (  y,5^(k|k-l)Xj)b( 

j- 1  J  I 

.( J  v;;j(k|k.i)Xj)b,^+  (  I  vJjJtklk-Dx.jb, 

j  =  l  J  I 

(J^v5l^(k|k-Ukj)b„  -  a/Q5^(l‘lk-l)>j)b, 

§qQ  •  *  <  j/w 

J“  I  x'  , 

-( j^v5;j(k|k-i]»j)b,g  *  a  v5j^(k|k-i)>j)b 

Now  calculate  V^{k|k)  =  [I  -  G(K)A]V^(k| k-1 ) 

[I  -  GA]  =  Gjj  Gjg  Aj^,  0 -  0 

. 


=  [I  -  GA]  =  rSjj(k)  Sjq(k)' 


V5^(kik)  =  rsii(k)  Sjp(kr|rv„(kik-i)  VjQ(kik-i) 


S„.(k)  s„„(k)  v«,(k|k-l)  V.n(Mk-l) 


Vjj(k|k)  =  Sjj(k)Vjj{k|k-l)  +  SjQ(k)VQj(klk-l) 
VjQ(klk)  =  Sjj(k)VjQ(klk-l)  +  SjQ(k)VQQ{k|k-l) 
VQi(klk)  =  SQj{k)V„(klk-l)  +  SQQ{k)VQj(klk-l) 


VQQ(k|k)  =  SQQ(k)VQ^(klk-l)  +SQj(k)VjQ(klk.l) 


Sjj(k) 


j ( 1 ) A 2 » • 
-Gjj{N)x^,  -Gjj(N)X2,. 


, .  -Gjj{2)X|^ 


-  1-G„(N)X^ 


[S;5^(k)]  =  -GjQ(i)X. 


[S’|''(k)]  =  -6Qi(i)x. 


^QI 

SgQ(k) 


l-GqQ(l)X^,  -Ggg(l)X2....  -Gqq(1)’'N 

1-Gqq(2)x^,  1-^q(2)X2....  -^Q(2)Xfj 

-^q(N)x^,  -Gqq(N)x2...--  ■'-^q(n)x,^ 
c-  ■ 

Summary 

1.  V;^(k|k-i;  =  $V^(k-l|k-l)J  +  rr' 

2.  G{k)  =  V:^(k|k-1)A'^B'^k) 

3.  VWk|k)  =  [I  -  G{k)A]V^(klk-l) 

XX 


when 
k  =  1 

Initialize  V^(0|0)  =  0. 
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■BSESiS^ 


[Vjf'dIO)]  .  VjYj  ♦  Yj.Yj 

[VJq^OIO)]  -  -Y,y]  ♦  YjYj  ! 

.  ,  NMe  vJjJdIO)  -  V^dlo) 

tv’;^dlo)]..Yi,^*Y,Yji  . 

"lo^cio)  = -v’;Jd|0) 

[vJ^^dio)].Y,Yj*Y;Yj  ; 


N  N 


N  N 


I 


5 


3'  b 


Note  B’  (1)  = 


1 

^-b'2  b*  b 


"  N  N 

*  ’Wl'j)*’  -  *  ’'Nd)\i)(-b')_ 


*  ‘jy-Vj  * 

~  N  N  1 

(.M-Y^Yj  +  Y,-Yj)Xj)b  -  (  I  (7.Y.  +  Y|Y-)^Jb' 

J  =  1  ’  J,  ^  J  J  j  =  1  ’  J  ’  J  J 

» 

*  Vj^db  .  (  y  (YiY,  *  TlYdidb' 


b2-b' 


,(i)  =  ^  Y^Yj)Xj)(-b-)  +  +  y\yj)^y 


-{  J^(-YNYj  +  YNYj)Xj(-b-)  +  (  J^(YNYj  +  Y,;|YpXj)b 


Note  Gjj(l)=GpQ(l)  Gjp(l)  =  -Gqj(1) 


b2-b'2 


c.  Sjj(i)  -  s^pd) 


Viidio)  =  V  (1|0) 


Si.d)  =  -s,,d)  V,,dlO)  =  -V_.dlO) 


Vjjdd)  =  Sjjd)Vjjdio)  +  Sjf,d)Vnjd|o) 


iQ'‘''Qr 


Viq(i|i)  =  Sjjd)Vjpdio)  +  Sjpd)Vppdio) 
Vpidd)  =  Spjd)v„d|0)  +  Sppd)VQjd|0) 

Vppdll)  =  Sppd)Vppd|0)  +Spjd)Vjpd|0) 

ViidlD  =  VppdiD 

VindP)  =  -VnidP) 


a.  [v;|j(2|l)]  =  +  <^I.frp[vjj^'d|l)]  +  -  4,;..^j)[V;*Jd|l)] 

[vi^j(2|i)]  =  (-^.4.1  +  ^.fj)Cvji^'d(i)]  +  +  .^:*i)Cv;5^’d(i)] 


[vjjJ(2|i)]  =  (-4;^.  +  4.4<^-)[vj|^dn)]  -  +  ^^^j)[v;5Jdii)] 


I  I  X  • 

^  dd 


[vj’j(2|i)]  =  +  ^>j)[v;|j(i|i)]  + 

Note  Vjj(2d)  =  Vpp(2|1) 

V,J2|1)  =  -V.j(211) 


— ~  9. 

SiQ(k)  =  -^j{k)  =  £' 

From  (29) 

Vii{k|k)  =  VqQ(k|k) 

Vig(klk)  =  -VQj(klk) 

k  =  k+1 

Remark: 

When  the  initialization  Vjj(l(0)  =  VQq(l|0)  and  Vjq(1|0)  =  -Vqj{1(0) 

is  given  it  follows  for  arbitrary  k  that  the  diagonal  elements  of  the  parti¬ 
tioned  matrices  are  identical  and  the  off  diagonal  elements  are  identical 
but  different  in  sign  for  Vy^(k|k-1),  B(k),  G(k)  and  V'v^(k|k).  Thus  are 
the  initial  results  proved. 
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